Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Per-stream state support for Postgres source #13609

Merged
merged 34 commits into from
Jun 21, 2022
Merged

Per-stream state support for Postgres source #13609

merged 34 commits into from
Jun 21, 2022

Conversation

jdpgrailsdev
Copy link
Contributor

@jdpgrailsdev jdpgrailsdev commented Jun 8, 2022 •
edited
Loading

What

How

  • Refactor state management logic in the database connectors framework to selectively choose the proper state management logic based on the state data object provided to the source connector at runtime.
  • Refactor out cursor management from the state manager to reduce code duplication.
  • Solution is a work in progress and does not currently handle either the new "global" state or "CDC" state, though there are placeholders in the StateManagerFactory for these cases.
  • There is still an issue with the legacy CDC functionality. The existing code treats it as a bolt-on to the existing state manager, making it difficult to abstract this bit away. Once the new "CDC" message format is agreed upon and a new state manager is created, I will cycle back to determine how best to retrofit the existing sources that also use CDC (MySQL and MSSQL at least).

* N.B. The solution is partial and subject to change, as the format of the state message has not yet been finalized. The protocol changes are now final, so this PR should be stable.

Recommended reading order

  1. StateManagerFactory.java
  2. CursorManager.java
  3. StateManager.java (interface)
  4. LegacyStateManager.java (based on the existing StateManager.java class)
  5. StreamStateManager.java
  6. GlobalStateManager.java
  7. AbstractDbSource.java
  8. PostgresSource.java
  9. JdbcSourceAcceptanceTest.java (updated to support both legacy connectors and the Postgres connector which will use the new state message format).

🚨 User Impact 🚨

There will be no user impact until the use of per-stream support is exposed via the UI/API

Tests

There are failing tests, which is expected until the state message format is finalized and the PR can be updated to handle both the global and CDC cases.

Unit
  • All existing unit tests in the relational-db and postgres sources pass.
  • All new classes to support state management in the relational-db have corresponding unit tests/copies of existing unit tests for refactored/moved code.
Acceptance
  • Acceptance tests for the Postgresql source are currently partially passing. Non-CDC tests have been fixed to choose the proper state object and are passing. CDC-related tests are failing, due to the fact that CDC state management has not yet been implemented. This is known/on purpose and will be fixed as the message format is finalized.

@github-actions github-actions bot added the area/connectors Connector related issues label Jun 8, 2022
cgardens
cgardens reviewed Jun 9, 2022
View reviewed changes
Copy link
Contributor

@cgardens cgardens left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just leaving a comment.

direction looks great! encapsulation of the different state concerns is great and easy to test. happy to take another look once it integrates the new message struct.

...rs/source-postgres/src/main/java/io/airbyte/integrations/source/postgres/PostgresSource.java
@@ -404,6 +406,25 @@ private static AirbyteStream addCdcMetadataColumns(final AirbyteStream stream) {
return stream;
}

// TODO This is a temporary override so that the Postgres source can take advantage of per-stream
// state.
@Override
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice. i like this approach so that only postgres is affected.

@jdpgrailsdev jdpgrailsdev force-pushed the jonathan/postgres-source-stream-state branch from ad1723f to ef16206 Compare June 10, 2022 13:37
@benmoriceau
Copy link
Contributor

The isolation to having only postgres looks great. I think that if we merge this today, it will remove the possibility to do a cdc sync. Should the supportsPerStream take some configuration as an input in order to use the legacy mode if we have a cdc connection?

benmoriceau
benmoriceau previously requested changes Jun 10, 2022
View reviewed changes
Copy link
Contributor

@benmoriceau benmoriceau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I got a comment about the supportsPerStream function.

@jdpgrailsdev
Copy link
Contributor Author

@benmoriceau Yes...I'm not 100% sure how to handle the CDC case when we have moved to per-stream. I almost feel like the platform should still send the legacy format if CDC is involved so that we don't attempt to move it to per-stream...yet. If that is not an option then the method may need to be modified to look at the config. Currently, I have the factory doing that check but have not yet created the actual state manager for CDC. I am mainly waiting for the protocol message update to happen and then react to that.

@jdpgrailsdev jdpgrailsdev force-pushed the jonathan/postgres-source-stream-state branch from 7a3d2d7 to 1a4ad84 Compare June 13, 2022 13:28
@jdpgrailsdev jdpgrailsdev changed the title WIP Per-stream state support for Postgres source Per-stream state support for Postgres source Jun 13, 2022
@jdpgrailsdev jdpgrailsdev force-pushed the jonathan/postgres-source-stream-state branch from 017b262 to 0415c0f Compare June 13, 2022 19:52
@jdpgrailsdev
Copy link
Contributor Author

jdpgrailsdev commented Jun 13, 2022 •
edited by github-actions bot
Loading

/test connector=connectors/source-postgres

🕑 connectors/source-postgres https://github.com/airbytehq/airbyte/actions/runs/2490819552
❌ connectors/source-postgres https://github.com/airbytehq/airbyte/actions/runs/2490819552
🐛 https://gradle.com/s/h2gvwmbcxpzxm

Build Failed

Test summary info:

Could not find result summary

@jdpgrailsdev jdpgrailsdev marked this pull request as ready for review June 13, 2022 19:57
@jdpgrailsdev
Copy link
Contributor Author

@cgardens @benmoriceau @lmossman @subodh1810 This PR is now ready for review. There still may be some issues to work through regarding the acceptance/integration tests, but I believe that it is complete. Let me know if it would valuable to do a face to face review/run through of the code to get everyone up to speed on what is changing.

@jdpgrailsdev
Copy link
Contributor Author

jdpgrailsdev commented Jun 13, 2022 •
edited by github-actions bot
Loading

/test connector=connectors/source-mysql

🕑 connectors/source-mysql https://github.com/airbytehq/airbyte/actions/runs/2490906110
❌ connectors/source-mysql https://github.com/airbytehq/airbyte/actions/runs/2490906110
🐛 https://gradle.com/s/a3qitxglcqnjc

Build Failed

Test summary info:

Could not find result summary

@jdpgrailsdev
Copy link
Contributor Author

jdpgrailsdev commented Jun 13, 2022 •
edited by github-actions bot
Loading

/test connector=connectors/source-mssql

🕑 connectors/source-mssql https://github.com/airbytehq/airbyte/actions/runs/2490906440
❌ connectors/source-mssql https://github.com/airbytehq/airbyte/actions/runs/2490906440
🐛 https://gradle.com/s/zwljcdkib3foc

Build Failed

Test summary info:

Could not find result summary

@jdpgrailsdev
Copy link
Contributor Author

I am investigating the failing tests, which appear to be related to the change in the protocol message format.

cgardens
cgardens reviewed Jun 14, 2022
View reviewed changes
Copy link
Contributor

@cgardens cgardens left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense to me. The code reuse is great!

The generics in the StateManager were a little hard for me to follow. If I'm tracking right, once we dump legacy though, we can factor out the generics.

...tional-db/src/main/java/io/airbyte/integrations/source/relationaldb/state/CursorManager.java
.map(ConfiguredAirbyteStream::getStream)
.map(AirbyteStreamNameNamespacePair::fromAirbyteSteam)
.collect(Collectors.toSet());
allStreamNames.addAll(streamSupplier.get().stream().map(namespacePairFunction).filter(n -> n != null).collect(Collectors.toSet()));
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

.filter(n -> n != null) when is n ever null in this filter?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@cgardens This is a bit of a mess, mostly due to the fact that we start with an empty state. Now that we have changed the structure, it is entirely possible to have an empty-ish stream descriptor in the empty state. When this happens (e.g. a descriptor that either has a null namespace or name), it ends up becoming a null. Those then need to be filtered out of this stream. Not the cleanest and could definitely use some improvement. This entire function (namespacePairFunction) is really temporary due to the legacy support. I will take another pass at it now that most of the logic is done for cleanup. I think that this, along with the generics, may be something I can clean up.

...tional-db/src/main/java/io/airbyte/integrations/source/relationaldb/state/CursorManager.java Show resolved Hide resolved
...tional-db/src/main/java/io/airbyte/integrations/source/relationaldb/state/CursorManager.java Outdated Show resolved Hide resolved
...elational-db/src/main/java/io/airbyte/integrations/source/relationaldb/AbstractDbSource.java Outdated
* @param stateJson The state as JSON.
* @return The deserialized object representation of the state.
*/
protected List<AirbyteStateMessage> deserializeState(final JsonNode stateJson) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is what we were discussing today. In an ideal world it would be great if this could live on the other side of the Source interface. Until we have versioning it has to be here.

...l-db/src/main/java/io/airbyte/integrations/source/relationaldb/state/GlobalStateManager.java
* @return The {@link CdcState} stored in the state, if any. Note that this will not be {@code null}
* but may be empty.
*/
private CdcState extractCdcState(final AirbyteStateMessage airbyteStateMessage) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is the "bolt-on" that you mentioned in the PR description, right?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. For whatever reason, the CDC state is not its own state manager in the existing code. Instead, the state rides along in the DbState and is managed by the CdcStateManager class, which is encapsulated in the state manager.

...l-db/src/main/java/io/airbyte/integrations/source/relationaldb/state/StreamStateManager.java Show resolved Hide resolved
...l-db/src/main/java/io/airbyte/integrations/source/relationaldb/state/StreamStateManager.java Show resolved Hide resolved
@jdpgrailsdev jdpgrailsdev force-pushed the jonathan/postgres-source-stream-state branch from 84b5010 to 6f75fd2 Compare June 14, 2022 13:37
subodh1810
subodh1810 reviewed Jun 14, 2022
View reviewed changes
Copy link
Contributor

@subodh1810 subodh1810 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Woah this is very nicely done! I am half way done with the review and wanted to leave my comments mid way! While reviewing the PR I thought of a scenario and wanted to trigger a discussion on it. Imagine a customer sets up a Postgres connector in CDC mode and runs few syncs, then changes the connector to non-CDC mode but the tables stay in INCREMENTAL sync mode. Now we have global state in our database and we would try to use the GlobalStateManager in the upcoming syncs when we should be using StreamStateManager
@cgardens @grishick @jdpgrailsdev

...-db/src/main/java/io/airbyte/integrations/source/relationaldb/state/StateManagerFactory.java Outdated Show resolved Hide resolved
...-db/src/main/java/io/airbyte/integrations/source/relationaldb/state/StateManagerFactory.java Outdated
final ConfiguredAirbyteCatalog catalog,
final JsonNode config) {
if (state != null && !state.isEmpty()) {
final AirbyteStateMessage airbyteStateMessage = state.get(0);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We determine the state manager based on the state type attribute of the first element which makes me feel why is this info being duplicated for each stream then? The current AirbyteStateMessage looks like

    private AirbyteStateMessage.AirbyteStateType stateType;
    @JsonProperty("stream")
    private AirbyteStreamState stream;
    @JsonProperty("global")
    private AirbyteGlobalState global;
    /**
     * (Deprecated) the state data
     * 
     */
    @JsonProperty("data")
    @JsonPropertyDescription("(Deprecated) the state data")
    private JsonNode data;

Instead shouldnt the private AirbyteStreamState stream; be List<AirbyteStreamState> streams; (just like we have it in the private AirbyteGlobalState global;)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@subodh1810 I will ping in @cgardens and @benmoriceau here. I think the intent is that there will be a state message for each stream. In the other two cases (legacy and global) there is only one state message produces. Because of the per-stream case, this means that a list of states may be passed to the source on execution. I agree that this code is a bit wonky and could be remedied by having a protocol version AND having a type/interface that represents the state data. In that case, the type could be pushed there and it could also include a list of state messages. Something like:

interface ConnectorState {

    StateType type();
    
    List<AirbyteStateMessage> states();
    
}

However, we are not there yet.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 to what @jdpgrailsdev mentioned.

...-db/src/main/java/io/airbyte/integrations/source/relationaldb/state/StateManagerFactory.java Outdated Show resolved Hide resolved
...ational-db/src/main/java/io/airbyte/integrations/source/relationaldb/state/StateManager.java Outdated Show resolved Hide resolved
...l-db/src/main/java/io/airbyte/integrations/source/relationaldb/state/GlobalStateManager.java Outdated
*/
private CdcState extractCdcState(final AirbyteStateMessage airbyteStateMessage) {
if (airbyteStateMessage.getStateType() == AirbyteStateType.GLOBAL) {
return Jsons.object(airbyteStateMessage.getGlobal().getSharedState(), DbState.class).getCdcState();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here is my concern with this method, when we emit the state we split the JSON into sharedState and streams

  @Override
  public AirbyteStateMessage toState(final AirbyteStreamNameNamespacePair pair) {
    // Populate global state
    final AirbyteGlobalState globalState = new AirbyteGlobalState();
    globalState.setSharedState(Jsons.jsonNode(getCdcStateManager().getCdcState()));
    globalState.setStreamStates(StateGeneratorUtils.generateStreamStateList(getPairToCursorInfoMap()));

    // Generate the legacy state for backwards compatibility
    final DbState dbState = StateGeneratorUtils.generateDbState(getPairToCursorInfoMap())
        .withCdc(true)
        .withCdcState(getCdcStateManager().getCdcState());

    return new AirbyteStateMessage()
        .withStateType(AirbyteStateType.GLOBAL)
        // Temporarily include legacy state for backwards compatibility with the platform
        .withData(Jsons.jsonNode(dbState))
        .withGlobal(globalState);
  }

But when we read it back we are trying to map it into the DbState class which seems incorrect. I think the usage of DbState class should only be for Legacy i.e. for data field only and once the conversion has happened we should not try to map things to DbState cause the state has been split in shared and individual streams

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here is my concern with this method, when we emit the state we split the JSON into sharedState and streams

  @Override
  public AirbyteStateMessage toState(final AirbyteStreamNameNamespacePair pair) {
    // Populate global state
    final AirbyteGlobalState globalState = new AirbyteGlobalState();
    globalState.setSharedState(Jsons.jsonNode(getCdcStateManager().getCdcState()));
    globalState.setStreamStates(StateGeneratorUtils.generateStreamStateList(getPairToCursorInfoMap()));

    // Generate the legacy state for backwards compatibility
    final DbState dbState = StateGeneratorUtils.generateDbState(getPairToCursorInfoMap())
        .withCdc(true)
        .withCdcState(getCdcStateManager().getCdcState());

    return new AirbyteStateMessage()
        .withStateType(AirbyteStateType.GLOBAL)
        // Temporarily include legacy state for backwards compatibility with the platform
        .withData(Jsons.jsonNode(dbState))
        .withGlobal(globalState);
  }

But when we read it back we are trying to map it into the DbState class which seems incorrect. I think the usage of DbState class should only be for Legacy i.e. for data field only and once the conversion has happened we should not try to map things to DbState cause the state has been split in shared and individual streams

@subodh1810 This is here for backwards compatibility/to work with the scenario where the connector has this code, but the platform doesn't.

...rs/source-postgres/src/main/java/io/airbyte/integrations/source/postgres/PostgresSource.java Outdated Show resolved Hide resolved
...l-db/src/main/java/io/airbyte/integrations/source/relationaldb/state/StreamStateManager.java Show resolved Hide resolved
@jdpgrailsdev jdpgrailsdev force-pushed the jonathan/postgres-source-stream-state branch from 4271cf1 to 406698e Compare June 14, 2022 20:32
@jdpgrailsdev
Copy link
Contributor Author

jdpgrailsdev commented Jun 14, 2022 •
edited
Loading

Woah this is very nicely done! I am half way done with the review and wanted to leave my comments mid way! While reviewing the PR I thought of a scenario and wanted to trigger a discussion on it. Imagine a customer sets up a Postgres connector in CDC mode and runs few syncs, then changes the connector to non-CDC mode but the tables stay in INCREMENTAL sync mode. Now we have global state in our database and we would try to use the GlobalStateManager in the upcoming syncs when we should be using StreamStateManager @cgardens @grishick @jdpgrailsdev

@subodh1810 Agreed. @lmossman and I did some pair programming and have updated the StateManagerFactory to better handle the transition cases you outlined above. At first, I was under the assumption that changes would be accompanied first by a reset, which would avoid the problem. However, after looking at it some more and thinking about your comment, we definitely shouldn't rely on the platform to perform a reset. There are also other cases where we would want to transition between the state types without wiping out the state. The PR has been updated to attempt to address it.

@jdpgrailsdev jdpgrailsdev force-pushed the jonathan/postgres-source-stream-state branch from 5b555fb to 86891b9 Compare June 15, 2022 13:31
@jdpgrailsdev jdpgrailsdev force-pushed the jonathan/postgres-source-stream-state branch from fd23162 to ef81d69 Compare June 21, 2022 13:29
@jdpgrailsdev jdpgrailsdev merged commit 6ca4017 into master Jun 21, 2022
@jdpgrailsdev jdpgrailsdev deleted the jonathan/postgres-source-stream-state branch June 21, 2022 19:35
pdulapalli added a commit to falkonai/airbyte that referenced this pull request Jun 29, 2022
@pdulapalli @lgomezm
@gosusnp @Amruta-Ranade @supertopher @malikdiarra @teallarson @timroes @benmoriceau @lmossman @VitaliiMaltsev @octavia-squidington-iii @grishick @evantahler @girarda @tuliren @sashaNeshcheret @marcosmarxm @xiaohansong @alafanechere @cgardens @sophia-wiley @edgao @davydov-d @subodh1810 @b4stien @harshithmullapudi @Imbruced @grubberr @bazarnov @edmundito @alexander-marquardt @Phlair @mutt-santiago-stachuk @davinchia @arsenlosenko @ptiurin @DoNotPanicUA @jdpgrailsdev @ganpatagarwal @Rajakavitha1 @suhomud @swyxio @etsybaev @annalvova05 @dizel852 @pmossman @adam-bloom @brianjlai @git-phu @kimerinn @sajarin @stevewithington @leosussan @ss098 @Tomperez98 @sherifnada @yurii-bidiuk @ChristopheDuong @schung507 @mohamagdy @terussell85 @alexandertsukanov @pedroslopez @terencecho @danieldiamond @drrest @avaidyanatha @Zawar92 @gittysachin @cjwooo @jrhizor @tisonkun @RobertoBonnet @alovew
Update from upstream (#9)
bd579a0 
* source-notion: Updated docs as per new format (#13708)

* Keep doc up-to-date with changes (#13667)

`airbyte-db/lib` has been renamed to `airbyte-db/db-lib`

* Updated BigQuery, Google Sheets, Facebook Marketing, Salesforce docs (#13717)

* initial changes

* Edited google Sheets doc

* More edits

* edited the intro and prereqs for BigQuery

* edited the data loading section

* more edits

* Grammatical edits

* Formatting edits

* Adds zombie removal tool (#13718)

* Adds zombie removal tool

* Corrects endpoint adds comments

* Adds API links

* Changes search logic, fixes escape character

* Corrects help text

* Fix connection read object building (#13568)

Make sure the sourceCatalogId field is set with the value stored in the
database.

* fix modal overlay problem (#13724)

* Improve Gradle build and fix storybook (#13719)

* Improve Gradle build and fix storybook

* Run all copy tasks after copyDocker

* fix stream descriptor typo (#13726)

* Save streams to reset in job config when creating reset job (#13703)

* save streams to reset in job config when creating reset job

* change streamDescriptors to streamsToReset

* :bug: Postgres Source: fixed unsupported date-time datatypes during incremental sync (#13655)

* Postgres Source: fixed unsupposted date-time datatypes during incremental sync

* updated CHANGELOG

* add tests for incremental cursor check

* removed star import

* Postgres Source: fixed unsupposted date-time datatypes during incremental sync

* updated CHANGELOG

* add tests for incremental cursor check

* removed star import

* add timestamp datatype test

* Bump version in Dockerfile

* auto-bump connector version

Co-authored-by: grishick <greg@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Bump version in Dockerfile to match source-postgres version (#13732)

* Fail the connection state instead of throwing an exception (#13728)

* Fail the connection state instead of throwin exception

* Fix test

* rm import

* Update airbyte-workers/src/main/java/io/airbyte/workers/general/DefaultCheckConnectionWorker.java

Co-authored-by: Evan Tahler <evan@airbyte.io>

Co-authored-by: Evan Tahler <evan@airbyte.io>

* [low-code connectors] add a few unit tests (#13666)

* add a couple of unit tests

* refactor tests

* 🎉 Destination databricks: rename to databricks lakehouse (#13722)

* Update Databricks naming

* Update destination_spec

* Update BOOTSTRAP.md

* Update Dockerfile

* Update README.md

* Update spec.json

* Update databricks.md

* Update databricks.md

* Update airbyte-integrations/connectors/destination-databricks/BOOTSTRAP.md

Co-authored-by: LiRen Tu <tuliren.git@outlook.com>

Co-authored-by: LiRen Tu <tuliren.git@outlook.com>

* Fallback to parsing datetime and time strings w/ and w/o timezones in case DateTimeParseException is thrown (#13745)

* Fall back to parsing w/ or w/o TZ if parsing a date or a time string fails
* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Bump source-postgres-strict-encrypt version to 0.4.23 to match source-postgres version (#13747)

* S3 and GCS destinations: Updating processing data types for Avro/Parquet formats (#13483)

* S3 destination: Updating processing data types for Avro/Parquet formats

* S3 destination: handle comparing data types

* S3 destination: clean code

* S3 destination: clean code

* S3 destination: handle case with unexpected json schema type

* S3 destination: clean code

* S3 destination: Extract the same logic for Avro/Parquet formats to separate parent class

* S3 destination: clean code

* S3 destination: clean code

* GCS destination: Update data types processing for Avro/Parquet formats

* GCS destination: clean redundant code

* S3 destination: handle case with numbers inside array

* S3 destination: clean code

* S3 destination: add unit test

* S3 destination: update unit test cases with number types.

* S3 destination: update unit tests.

* S3 destination: bump version for s3 and gcs

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Source Salesforce: fix sync capped streams with more records than page size (#13658)

* change logic for counting records

* update doc

* correct unit test

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Docs: update normalization doc (#13739)

* update dbt version in custom normalization (#13742)

* Kube fix and Docs for open telemetry integration (#13701)

* Create interface, factory for metric client

* remove unused func

* change count val to use long

* PR fix

* otel metric client implementation

* merge conflicts resolve

* build fix

* add a test, moved version into deps catalog

* fix test

* add docs for open telemetry

* fix kube setting for otel, and add doc

* helm related fields update for opentel

* cdk: fix typo in build.gradle.hbs (#13761)

* Bump Airbyte version from 0.39.17-alpha to 0.39.18-alpha (#13759)

Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
Co-authored-by: Benoit Moriceau <benoit@airbyte.io>

* Update destinations to handle new state messages (#13670)

* 🐛 Postgres Source: fixed truncated precision if the value of the milliseconds or seconds is 0 (#13549)

* Postgres Source: fixed truncated precision if the value of the millisecond or second is 0

* check CI with 1.15.3 testcontainer

* check CI with 1.15.3 testcontainer

* returned latest version of testcontainer

* fixed checkstyle

* fixed checkstyle

* returned latest testcontainer version

* updated CHANGELOG

* bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Postgres source strict encrypt trucnated precision bump version (#13769)

* Postgres Source: fixed truncated precision if the value of the millisecond or second is 0

* check CI with 1.15.3 testcontainer

* check CI with 1.15.3 testcontainer

* returned latest version of testcontainer

* fixed checkstyle

* fixed checkstyle

* returned latest testcontainer version

* updated CHANGELOG

* bump version

* auto-bump connector version

* Postgres source strict encrypt bump version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Migrate StateDB to support per stream states (#13731)

* Update StateDB to support per Stream states.
* Add `StateType` type
* Add `steam_name`, `namespace` and `type` to `state` table.
* Set the default StateType to LEGACY

* Update getting-started-with-airbyte-cloud.md (#13741)

* Update getting-started-with-airbyte-cloud.md

Edited Getting Started with Airbyte Cloud guide to match the updated Cloud UI.

* Update getting-started-with-airbyte-cloud.md

Updated based on Amruta's suggestions.

* 🐛  Normalization correctly propagates deletions to the final tables (#12846)

* Update Airbyte Protocol Docs (#13709)

* Source Facebook marketing: fix `not syncing any data` issue (#13749)

* #253 oncall source fb marketing: fix  issue

* #253 oncall: upd changelog

* Update docs/integrations/sources/facebook-marketing.md

* auto-bump connector version

Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Ignore custom connectors during connectors update (#13581)

* Ignore Custom connectors during connectors update

* Skip any connector flagged as custom as well

* Format

* [low-code connectors] Support for list-based stream slicers (#13668)

* list slicer

* Add comment

* test

* ast eval

* refactor

* fix

* remove print

* rename

* return a generator

* smaller fix and reset to master

* union type hint

* assert

* comment

* format

* 📝 Postgres source: add troubleshooting for postgres hot standby (#13784)

* Add troubleshooting section in postgres doc

* Update doc

* Add one more solution

* upgrade debezium version for postgres to 1.9.2 (#13368)

* upgrade debezium version for postgres to 1.9.2

* fix test+build

* fix build

* address review comments

* update link to docs

* fix test

* 🐛 Source Amplitude: Fix an infinite loop (#13638)

* Fix infinite loop when fetching Amplitude data

* Update changelog and version

* Address review

* fix: unit tests were failing

* chore: bump version in source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>

* octavia-cli: allow user to set custom API HTTP headers(#12893)

* 🎉 Source Github: Fix API sorting, fix `get_starting_point` caching (#13707)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* 🐛 Source Zendesk Support: fixed 429 error for `TicketMetrics` stream (#13757)

* Add some dev-facing normalization docs (#13780)

* Fix mysql cdc acceptance test (#13795)

* fix mysql cdc acceptance test

* remove comments

* doc: add link to forum in plopfile (#13560)

* Make connector adaptable based on deployment mode (#13522)

* Add deployment mode to env shared with jobs

* Add adaptive runners

* Migrate postgres source to use adaptive runner

* Add an array of specs in docker image spec definition

* Add copyright

* Parse docker image spec with specs list

* Update spec yaml files

* Pass in DEPLOYMENT_MODE to docker compose file

* Revert "Parse docker image spec with specs list"

This reverts commit 8fe41dd3b7fa5306ba8b62d660c002420adb9b23.

* Revert changes in docker image spec

* Read cloud specific spec files based on deployment mode

* Revert "Update spec yaml files"

This reverts commit 059f326432dba1f8da4ad4dfd8d5ac7a14de66c3.

* Publish cloud spec file if necessary

* Fix upload script

* Move test files

* Update docker compose file

* Format code

* Add comment about spec filename

* Add unit tests

* Remove redundant jdbc acceptance test

When running `PostgresStrictEncryptJdbcSourceAcceptanceTest`, the `discover` method tests always fail because there are unexpected columns in the catalog:
- `wakeup_at`
- `last_visited_at`
- `last_comment_at`

These columns only exist in `PostgresJdbcSourceAcceptanceTest`. And this failure cannot be reproduced locally.

The hypothesis is that when the JDBC unit tests are run on CI, they are run in parallel, and the same testcontainer is used for both tests. That's why the strict encrypt test can discover columns from the oridinary unit test.

Given that the JDBC strict encrypt test is basically redundant, it is removed.

* Update color palette, add scss colors, borders, and spacing (#13802)

* Add updated color palette to SCSS and theme
* Migrate current color palette to new colors

* Add border and spacing variables

* Remove legacy color mapping from scss side

* Add style guide to front end repo (#13418)

* Add .md from google doc draft

* update per review

* cleanup

* Update STYLEGUIDE.md

Co-authored-by: Tim Roes <tim@airbyte.io>

* Edited Stripe, HubSpot, Intercom docs (#13810)

* Initial edits

* Updated the Stripe connector doc

* Updated the Stripe doc

* Updated HubSpot and Intercom docs

* Minor sidebar edit

* Remove the catalog from the sidebar since the file has been deleted in Update Airbyte Protocol Docs (#13709) (#13813)

* Fix broken link (#13815)

* fixing broken links

* docusaurus updates

* Add METRIC_CLIENT and OTEL_COLLECTOR_ENDPOINT to .env files to fix kube deployments (#13817)

* octavia-cli: per workspace state (#13070)

* Fix LabeledSwitch component width (#13798)

* Fix LabeledSwitch component width

* Switch to new color palette

* Replace color

* Fix color variable

* Update 4-connection-checking.md (#13812)

* Update 4-connection-checking.md

As discussed in https://airbytehq-team.slack.com/archives/C02UQ9MJ4GG/p1655312684160609 - this example is misleading, as it does not actually connect to any API to validate connectivity.

* Update 4-connection-checking.md

Added a link to OneSignal check_connection, and move the "Note" to below the example

* Bump Airbyte version from 0.39.18-alpha to 0.39.19-alpha (#13820)

Co-authored-by: edgao <edgao@users.noreply.github.com>

* Normalization: Upgrade MySQL to dbt 1.0.0 (#11470)

* Restart workflow after activity failure instead of quarantining (#13779)

* use SHORT_ACTIVITY_OPTIONS on check connection activity so that it has retries

* retry workflow after delay instead of quarantining

* allow activity env vars to be configured in docker and kube

* add env var for workflow restart delay and refactor slightly

* update tests to handle new restart behavior

* update test name

* add empty env var values to .env files

* fail attempt before job in cleanJobState to prevent state machine failure

* change default value of max activity attempt retries from 10 to 5

* Bump Airbyte version from 0.39.19-alpha to 0.39.20-alpha (#13829)

Co-authored-by: lmossman <lmossman@users.noreply.github.com>

* 🎉 Postgres source: prepare for removing strict-encrypt variant (#13823)

* Bump postgres version

* Update doc

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* update readme (#13836)

* add evan, jonathan, charles as protocol reviews in codeowners (#13776)

* 📚 update MSSQL docs to reflect that we support normalization (#13826)

* [low-code connectors] Cartesian product stream slicer (#13740)

* list slicer

* Add comment

* product stream slicer

* comment

* rename

* format

* Update comment

* split on 2 lines for readability

* Revert "rename"

This reverts commit e801f2d1f859306c6a2b0d66d265753ee9e32a54.

* updated stacktrace format in java trace messages (#13847)

* updated stacktrace format in java trace messages

* test checks specifically on stacktrace in trace message

* remove unused import

* source-facebook-marketing: 🎉 Add fields to the ads_set stream (#13623)

* 🎉 Source Github: use GraphQL for `pull_request_stats` stream (#13763)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Tweak schema validation code for readability. (#13721)

* Refactor schema validation for better reading.

* Better comments.

* Format.

* source-facebook-marketing: bump to 0.2.53 (#13853)

* Source Hubspot - fix missing data issue (#13837)

* #278 oncall: source hubspot - fix missing data issue

* #278 oncall: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Source Amplitude: try-catch BadZipFile exception (#13846)

* #272 oncall: source Amplitude - try-catch BadZipFile exception

* #272-oncall: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* 🐛 Server can display streams with the same name in different namespaces (#13855)

* Updated connector catalog (#13862)

* Fix the running job counter (#13833)

* Add StateType and StateWrapper objects to the model (#13858)

* Emit orphan running jobs metrics (#13865)

That metrics show the number of jobs currently flagged as running that
are associated to inactive or deprecated connections.

* Add meaningful tests for OTEL client (#13831)

* Add meaningful tests for OTEL client

* PR comment fix

* code clean ups

* Persist state to reset connection job config (#13867)

* add current connection state to JobResetConnectionConfig

* pass state from reset connection config to job sync config in generate input activity

* format

* Source Google Analytics: Add threshold_days option, uncomment statement for incremental tests (#13871)

* Harshith/test pr 12536 (#13874)

* 🎉 New Source: Firebolt (#1)

* fix: Boolean type cast

* test: Improve format testing and doc

* refactor: Move some db functionality

* docs: Adding types doc link in utils

* feat: Use future-proof Auth in SDK

* fix: integration tests are failing

* chore: update seed file

Co-authored-by: Petro Tiurin <93913847+ptiurin@users.noreply.github.com>
Co-authored-by: ptiurin <petro.tiurin@firebolt.io>

* :bug: Source Relational DB : remove unicode nulls from cursors (#13854)

* Make sure that cursor value doesn't contain unicode null.

* Test that cursors doesn't contain unicode null

* incr version

* enableReinitialize on account form (#13622)

* #13888 source instagram: fix build (#13889)

* Fix md and lg spacing scss vars (#13886)

* Publishing java connectors with better formatted stacktrace in Trace messages (#13852)

* start

* revert

* azblob

* bq

* bq denorm

* megapublish baaaabyyyy

* fix needs

* matrix connectors

* auto-bump connector version

* dont failfast and max parallel 5

* multi runno

* minor

* testing matrix agents

* name

* testing multi agents

* tmp fix

* new multi agents

* multi test

* tryy

* let's do this

* magico

* fix

* label test

* couple more connector bumps

* temp

* things

* check this

* lets gooo

* more connectors

* Fix md and lg spacing scss vars (#13886)

* Delete TEMP-testing-command.yml

* auto-bump connector version

* Delete publish-command.yml

* added comment describing bash part

* running single thread

* catch sentry cli

* auto-bump connector version

* Update _variables.scss

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* octavia-cli: fix workspace not having anonymous_data_collection property (#13869)

* Update connection update calls to use central utility to ensure connection update has all data (#13564)

* Update connection updates with build update utility
* Add buildConnectionUpdate utility
* Update components that update the connection to use utility when necessary

* Use conection name when saving connection from replication view to prevent override from refreshed catalog

* Improve connection check on ReplicationView onSubmit function

* Display connection state in connection setting page (#13394)

* Display Connection State in Setting page

* memoize callback

* rendering and confirmaton

* setState API

* Input validation

* remove JSON step

* rename apiMethod to `updateState`

* test and adjust route

* skip if sync is running

* prevent state update when sync is running

* code editor component

* errors fixed

* scss style

* make linter happy

* Back to monaco editor

* Remove ability to edit state

* Adjust FE code

* Fix CSS problem

* Update airbyte-webapp/src/locales/en.json

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* just use PRE to render state for now

Co-authored-by: Tim Roes <tim@airbyte.io>
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* update api for per stream (#13835)

* Update airbyte-protocol.md (#13892)

* Update airbyte-protocol.md

* Fix typo

* Fix prose

* Add protocol reviewers for protocol documentation

* Remove duplicate

* Edited Amplitude, Mailchimp, and Zendesk Support docs (#13897)

* deleting SUMMARY.md since we don't need it for docusaurus builds (#13901)

* Do not hide unexpected errors in the check connection (#13903)

* Do not hide unexpected errors in the check connection

* Fix test

* Common code to deserialize a state message in the new format (#13772)

* Common code to deserialize a state message in the new format

* PR comments and type changed to typed

* Format

* Add StateType and StateWrapper objects to the model

* Use state wrapper instead of Either

* Switch to optional

* PR comments

* Support array legacy state

* format

Co-authored-by: Jimmy Ma <jimmy@airbyte.io>

* 🐛 Source Amazon Seller Partner: handle start date for financial stream (#13633)

* start and end date for finacial stream should not be more than 180 days apart

* improve unit tests

* make changes to start date for finance stream

* update tests

* lint changes

* update version to 0.2.22 for source-amazon-seller-partner

* Normalization: Fix incorrect jinja2 macro `json_extract_array` call (#13894)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Docs: fixed the broken links (#13915)

* 0.2.5 -> 0.2.6 (#13924)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* 13546 Fix integration tests source-postgres Mac OS (#13872)

* 13546 Fix integration tests source-postgres Mac OS

* 13548 Fixed integration tests source-tidb Mac OS (#13927)

* Source MsSql : incr ver to include changes #13854 (#13887)

* incr version

* put PR id

* docker ver

* connectors that published (#13932)

* Deprecate PART_SIZE_MB in connectors using S3/GCS storage (#13753)

* Removed part_size from connectors that use StreamTransferManager

* fixed S3DestinationConfigTest

* fixed S3JsonlFormatConfigTest

* upadate changelog and bump version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* upadate changelog and bump version for Redshift and Snowflake destinations

* auto-bump connector version

* fix GCS staging test

* fix GCS staging test

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Reverted changes in SshBastionContainer (#13934)

* 🎉 New Source Dockerhub (#13931)

* init

* implement working source + tests

* add docs

* add docs

* fix bad comments

* Update airbyte-integrations/connectors/source-dockerhub/acceptance-test-config.yml

* Update airbyte-integrations/connectors/source-dockerhub/Dockerfile

* Update airbyte-integrations/connectors/source-dockerhub/.dockerignore

* Apply suggestions from code review

* Update docs/integrations/sources/dockerhub.md

* Update airbyte-integrations/connectors/source-dockerhub/integration_tests/acceptance.py

Co-authored-by: George Claireaux <george@airbyte.io>

* address @Phlair's feedback

* address @Phlair's feedback

* each record is now a Docker image rather than response page

* format

* fix unit tests

* fix acceptance tests

* add icon, definition and generate seed spec

* add requests to requirements

Co-authored-by: sw-yx <shawnthe1@gmail.com>

* commented out non-relevant tests (#13940)

* Bump Airbyte version from 0.39.20-alpha to 0.39.21-alpha (#13938)

Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>

* newaction (#13942)

* remove test action (#13944)

* 🎉Source-mysql: aligned datatype test (#13945)

* [13607] source-mysql: aligned datatype tests for regular and CDC ways + added CHAR fix to CDC processing

* #13958 Source Stripe: fix configured catalogs (#13959)

* 🐛 Source: Typeform - Update schema for Responses stream (#13935)

* Upd responses schema

* Upd docs

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* :window: Updated email invitation flow that enables invited users to set name and create password (#12788)

* First pass accepting email link invitation
* Update Auth service with signInWithEmailLink calls
* Add AcceptEmailInvite component
* Update FirebaseActionRoute to handle sign in mode
* Rename ResetPasswordAction to FirebseActionRoute

* Add create password setp to AcceptEmailInvite component

* Remove continueURL from invite fetch

* Update accept email invite for user to enter both email and password together

* Set name during email link signup

* Update AcceptEmailInvite to send name
* Add updateName to UserService
* Update AuthService to set name during sign up

* Remove steps from AcceptEmailInvite component
Remove setPassword from AuthService

* Add header and title to accept invite page

* Move invite error messages to en file

* For invite link pages, show login link instead of sign up

* Disable name update on sign in via email lnk

* Resend email invite when the invite link is expired

* Fix status message in accept email invite page

* Re-enable set user's name during sign up email invite

* Update signUpWithEmailLink so that sign up is successful even if we fail to update the user's name

* Update comments on GoogleAuthService signInWithEmailLink

* Add newsletter and accept terms checkboxes to accept email invite component
* Extract signup form from signup page
* Extract fields from signup form
* Update accept email invite component to use field components from signup form
* Ensure that sign up button is disable until form is valid and security checkbox is checked

* Make error status text color in accept email link red

* Update workspace check in DefaultView so that user lands in workspace selector when there are no workspaces

* Add coment around continueUrl param usage in UserService

* Remove usless default case in GoogleAuthService

* Source Marketo: process fail during creation of an export job (#13930)

* #9322 source Marketo: process fail during creation of an export job

* #9322 source marketo: upd changelog

* #9322 source marketo: fix unit test

* #9322 source marketo: fix SATs

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* :window: :wrench: Add eslint rules for CSS modules (#13952)

* add eslint-plugin-css-modules rules

* Fixes:
- turn on eslint css modules rule as error
- remove unused styles

* add warning message if styled components is used

* Revert "add warning message if styled components is used"

This reverts commit 4e92b8b2110142bb679f15aeb034e377e0dcc69c.

* replace rule severity with words

* Update salesforce.md

Fixed broken link

* :window: 🔧 Add auto-fixable linting rules to webapp (#13462)

* Add new eslint rules that fit with our code style and downgrade rules to warn

* allowExpressions in fragment eslint rule

* Enable function-component-definition in eslint and fix styles

* Cleanup lint file

* Fix react/function-component-definition warnings manually

* Add more auto-fixable rules and fix

* Fix functions that require usless returns

* Update array-type rule to array-simple

* Fix eslint errors manually
disable assignmentExpression for arrays in prefer-destructuring rule

* Auto fix new linting issues after rebase

* Enhance /publish to allow for multiple connectors and parallel execution (#13864)

* start

* revert

* azblob

* bq

* bq denorm

* megapublish baaaabyyyy

* fix needs

* matrix connectors

* auto-bump connector version

* dont failfast and max parallel 5

* multi runno

* minor

* testing matrix agents

* name

* testing multi agents

* tmp fix

* new multi agents

* multi test

* tryy

* let's do this

* magico

* fix

* label test

* couple more connector bumps

* temp

* things

* check this

* lets gooo

* more connectors

* Delete TEMP-testing-command.yml

* auto-bump connector version

* added comment describing bash part

* running single thread

* catch sentry cli

* auto-bump connector version

* destinations

* + snowflake

* saved

* auto-bump connector version

* auto-bump connector version

* java source bumps

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* remove twice-defined methods

* label things

* revert action

* using the new test action

* point at action

* wrong tag on action

* update pool label

* update to use new ec2-github-runner fork

* this needs to be more generic than publisher

* change publish to run on pool

* add comment about runner-pool usage

* updated publish command docs for multi & parallel connector runs

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* unbump failed publish versions

* missed dockerfiles

* remove failed docs

* mssql fix

* overhauled the git comment output

* bumping a test connector that should work

* slight order switcheroo

* output connectors properly in first message

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Bump Airbyte version from 0.39.21-alpha to 0.39.22-alpha (#13979)

Co-authored-by: Phlair <Phlair@users.noreply.github.com>

* Parker/temporal cloud (#13243)

* switch to temporal cloud client for now

* format

* use client cert/key env secret instead of path to secret

* add TODO comments

* format

* add logging to debug timeout issue

* add more logging

* change workflow task timeout

* PR feedback: consolidate as much as possible, add missing javadoc

* fix acceptance test, needs to specify localhost

* add internal-use only comments

* format

* refactor to clean up TemporalClient and prepare it for future dependency injection framework

* remove extraneous log statements

* PR feedback

* fix test

* return isInitialized true in test

* 📄  Postgres source: fix CDC setup order in docs (#13949)

* postgres source: fix CDC setup order docs

* Update docs/integrations/sources/postgres.md

Co-authored-by: Liren Tu <tuliren@gmail.com>

* Per-stream state support for Postgres source (#13609)

* WIP Per-stream state support for Postgres source

* Fix failing test

* Improve code coverage

* Make global the default state manager

* Add legacy adapter state manager

* Formatting

* Include legacy state for backwards compatibility

* Add global state manager

* Implement Global/CDC state handling

* Fix test issues

* Fix issue with updated method signature

* Handle empty state case in global state manager

* Adjust to protocol changes

* Fix failing acceptance tests

* Fix failing test

* Fix unmodifiable list issue

* Fix unmodifiable exception

* PR feedback

* Abstract global state manager selection

* Handle conversion between different state types

* Handle invalid conversion

* Rename parameter

* Refactor state manager creation

* Fix failing tests

* Fix failing integration tests

* Add CDC test

* Fix failing integration test

* Revert change

* Fix failing integration test

* Use per-stream for postgres tests

* Formatting

* Correct stream descriptor validation

* Correct permalink

* PR feedback

* Bump Airbyte version from 0.39.22-alpha to 0.39.23-alpha (#13984)

Co-authored-by: pmossman <pmossman@users.noreply.github.com>

* Adds test for new workflow (#13986)

* Adds test for new workflow

* Adds airbyte repo

* remove testing line

* Add new InterpolatedRequestOptionsProvider that encapsulates all variations of request arguments (#13472)

* write out new request options provider and refactor components and parts of the YAML config

* fix formatting

* pr feedback to consolidate body_data_provider to simplify the code

* pr feedback get rid of extraneous optional

* publish oss for cloud (#13978)

workflow to publish oss artifacts that cloud needs to build against
use docker buildx to create arm images for local development

* skip debezium engine startup in case no table is in INCREMENTAL mode (#13870)

* 🎉 Source Github: break point added for workflows_runs stream (#13926)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* 6339: error when attempting to use azure sql database within an elastic pool as source for cdc based replication (#13866)

* 6339: debug info

* 6339: not using 'USE' on Azure SQL servers

* 6339: cleanup

* 6339: cleanup2

* 6339: cleanup3

* 6339: versions/changelogs updated

* 6339: merge from master (consolidation issue)

* 6339: dev connector version (for testing in airbyte cloud)

* 6339: code review implementation

* 6339: apply formatting

* in case runners fail to spin up, this needs to run on github-hosted (#13996)

* 12708: Add an option to use encryption with staging in Redshift Destination (#13675)

* 12708: Add an option to use encryption with staging in Redshift Destination

* 12708: docs/docker configs updated

* 12708: merge with master

* 12708: merge fix

* 12708: code review implementation

* 12708: fix for older configs

* 12708: fix for older configs in check

* 12708: merge from master (consolidation issue)

* 12708: versions updated

* :tada: New Source: Webflow (#13617)

* Added webflow code

* Updated readme

* Updated README

* Added webflow to source_definitions.yaml

* Enhanced documentation for the Webflow source connector

* Improved webflow source connector instructions

* Moved Site ID to before API token in Spec.yaml (for presentation in the UI)

* Addressed comments in PR.

* Changes to address requests in PR review

* Removed version from config

* Minor udpate to spec.yaml for clarity

* Updated to pass the accept-version as a constant rather than parameter

* Updated check_connection to hit the collections API that requires both site id and the authentication token.

* Fixed the test_check_connection to use the new check_connection function

* Added a streams test for generate_streams

* Re-named "autentication" object to "auth" to be more consistent with the way it is created by the CDK

* Added in an explict line to instantiante an "auth" object from WebflowTokenAuthenticator, to make it easier to describe in the blog

* Fixed a typo in a comment

* Renamed some classes to be more intuitive

* Renamed class to be more intuitive

* Minor change to an internal method name

* Made _get_collection_name_to_id_dict staticmethod

* Fixed a unit-test error that only appeared when running " python -m pytest -s unit_tests".
This was caused by Mocked settings from test_source.py leaking into test_streams.py

* format: add double quotes and remove unused import

* readme: remove semantic version naming of connector in build commands

* Updated spec.yaml

* auto-bump connector version

* format files

* add changelog

* update dockerfile

* auto-bump connector version

Co-authored-by: sajarin <sajarindider@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>

* Source-oracle: fixed tests + checkstyle (#13997)

* Source-oracle: fixed tests + checkstyle

* 🐛Destination-mysql: fixed integration test and build process (#13302)

* [13180] destination-mysql: fixed integration test

* update changelog to include debezium version upgrade (#13844)

* make table headers look less like successes (#13999)

* source-twilio: implement lookback windows (#13896)

* Revert "12708: Add an option to use encryption with staging in Redshift Destination (#13675)" (#14010)

This reverts commit aa28d448d820df9d79c2c0d06b38978d1108fb2c.

* Revert "6339: error when attempting to use azure sql database within an elastic pool as source for cdc based replication (#13866)" (#14011)

This reverts commit 0d870bd37bc3b5cd798b92115d73bcc45a42d8f7.

* [low-code connectors] BasicHttpAuthenticator (#13733)

* implement basichttpauthenticator

* add optional refresh access token authenticator

* remove prints

* type hints

* Fix and unit test

* missing test

* Add class to __init__ file

* Add comment

* migrate JsonSchemas to use basic path instead of JSONPath (#13917)

* scaffold for catalog diff, needs fixing on type handling and tests (#13786)

* Prepare release of JDBC connectors (#13987)

* Prepare release of JDBC connectors

* Update source definitions manually

* use built in check for if path is definite (#13834)

* 13535 Fixed bastion network for integration tests (#14007)

* doc: add error troubleshooting `docker-compose up` (#13765)

* fix: duplicate resource allocations in `airbyte-temporal` deployment (#13816)

* helm-chart: Fix worker deployment format error (#13839)

* add catalog diff connection read (#13918)

* doc: fix small typo on Shopify documentation (#13992)

* add streams to reset to job info (#13919)

* Generate api for changes in #13370 and make code compatible (#14014)

* Generate api for per-stream updates #13835 (#14021)

* Revert "Prepare release of JDBC connectors (#13987)" (#14029)

This reverts commit df759b30778082508e2872513800fac34d98ff7c.

* Fix per stream state protocol backward compatibility (#14032)

* rename state type field to fix backwards compatibility issue

* replace usages of stateType with type

* support semi incremental by adding extractor record filter (#13520)

* support semi incremental by adding extractor record filter

* refactor extractor into a record_selector that supports extraction and filtering of response records

* Remove pydantic spec from amazon ads and use YAML spec (#13988)

* add EdDSA support in SSH tunnel (#9494)

* add EdDSA support

* verify EdDSA support works correct

Co-authored-by: Yurii Bidiuk <yura.bidyuk@gmail.com>

* 🎉New source connector: source-metabase (#13752)

* Add docs

* Close metabase session when sync finishes

* Close session in check_connection

* Add source definition to seed

* Add icon

* improve cdc check for connectors (#14005)

* improve should use cdc check

* Revert "improve should use cdc check"

This reverts commit 7d01727279d21d33a6c18ed3227ee94432636120.

* improve should use cdc check

* add unit test

* Update webflow.md

* Update webflow.md

* Update webflow.md

* Remove legacy sentry code from cdk (#14016)

* rip sentry out of cdk

* remove sentry dsn from gsc

* Update webflow.md

* Update webflow.md

* Fixed broken links (#14071)

* 🪟Persist unsaved changes on schema refresh (#13895)

* add form values tracker context

* add clarifying comment

* add same functionality to create connection

* Update airbyte-webapp/src/components/CreateConnectionContent/CreateConnectionContent.tsx

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* Fixes broken links so we can deploy again (#14075)

also adds better error message for when this happens to others

* Adds symmary.md to gitignore (#14078)

* Added webflow icon (#14069)

* Added webflow icon

* Added icon

* Build create connection form build failure (#14081)

* Fix CDK obfuscation of nested secrets (#14035)

* Added Buy Credits section to Managing Airbyte Cloud (#13905)

* Added Buy Credits section to Managing Airbyte Cloud

* Made some style changes

* Made edits based on Natalie's suggestions

* Deleted link

* Deleted line

* Edited email address

* Updated reaching out to sales sentence

* disable es-lit to fix build (#14087)

* Release source connectors (#14077)

* Release source connectors

* Fix issue with database connection in test

* Fix failing tests due to authentication

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Bump Airbyte version from 0.39.23-alpha to 0.39.24-alpha (#14094)

Co-authored-by: jdpgrailsdev <jdpgrailsdev@users.noreply.github.com>

* Emit the state to remove in the airbyte empty source (#13725)

What
This PR updates the EmptyAirbyteSource in order to perform a partial update and handle the new state message format.

How
The empty will now emit different messages based on the type of state being provided:

Per stream: it will emit one message per stream that have been reset
Global: It will emit one global message that will contain null for the stream that have been reset including the shared state
Co-authored-by: Jimmy Ma <jimmy@airbyte.io>

* Add StatePersistence object (#13900)

Add a StatePersistence object that supports Read/Writes of States to the DB with StreamDescriptor fields

The only migrations that is supported are
* moving from LEGACY to GLOBAL
* moving from LEGACY to STREAM
* All other state type migrations are expected to go through an explicit reset beforehand.

* secret-persistence: Hashicorp Vault Secret Store (#13616)

Co-authored-by: Amanda Murphy <amanda.murphy@heapanalytics.com>
Co-authored-by: Benoit Moriceau <benoit@airbyte.io>

* 🐛 Source Hubspot: remove `AirbyteSentry` dependency (#14102)

* fixed

* updated changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* fix: format VaultSecretPersistenceTest.java (#14110)

* Source Hubspot: extend error logging (#14054)

* #291 incall - source Hubspot: extend error logging

* huspot: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Update webflow.md (#14083)

* Update webflow.md

Removed a description that is only applicable to people that are writing connector code, not to _users_ of the connector.

* Update webflow.md

* Update webflow.md

* Update webflow.md

* Update webflow.md

* 12708: Add an option to use encryption with staging in Redshift Desti… (#14013)

* 12708: Add an option to use encryption with staging in Redshift Destination (#13675)

* 12708: Add an option to use encryption with staging in Redshift Destination

* 12708: docs/docker configs updated

* 12708: merge with master

* 12708: merge fix

* 12708: code review implementation

* 12708: fix for older configs

* 12708: fix for older configs in check

* 12708: merge from master (consolidation issue)

* 12708: versions updated

* 12708: specs updated

* 12708: specs updated

* 12708: removing autogenerated files from PR

* 12708: changelog updated

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Source PayPal Transaction: Update Transaction Schema (#13682)

* Update transaction schema.
* Transform money values from strings to floats or integers.

Co-authored-by: nataly <nataly@airbyte.io>
Co-authored-by: Augustin <augustin.lafanechere@gmail.com>

* fix(jsonSchemas): raise error when items property not provided (#14018)

* fix stream name in stream transformation update (#14044)

* 🐛 Destination Redshift: Improved discovery for redshift-destination not SUPER streams (#13690)

airbyte-12843: Improved discovery for redshift-destination not SUPER tables, excluded views from discovery.

* Remove skiptests option (#14100)

* update sentry release script (#14123)

* Remove "additionalProperties": false from specs for connectors with staging (#14114)

* Remove "additionalProperties": false from spec for connectors with staging

* Remove "additionalProperties": false from spec for Redshift destination

* bump versions

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* [14003] source-oracle: added custom jdbc field (#14092)

* [14003] source-oracle: added custom jdbc field

* Add JobErrorReporter for sending sync job connector failures to Sentry (#13899)

* skeleton for reporting connector errors to sentry

* report on job failures instead of attempt failures

* report sync job failures with relevant metadata using JobErrorReporter

* send stack traces from python connectors to sentry

* test JobCreationAndStatusUpdate and JobErrorReporter

* logs

* refactor into helper, initial tests

* using sentry

* run format

* load reporting client from env

* load sentry dsn from env

* send java stack traces to sentry

* test sentryclient, refactor to use Hub instance

* ErrorReportingClient.report -> .reportJobFailureReason

* inject exception helper, test stack trace parse error tagging

* rm logs

* more stack trace tests

* remove logs

* fix failing tests

* rename ErrorReportingClient to JobErrorReportingClient

* rename vars in docker-compose

* Return an Optional instead of null when parsing stack traces

* dont remove airbyte prefix when setting release name

* from_trace_message static

* remove failureSummary from jobfailure input, get from Job

* send stacktrace string if we weren't able to parse

* set deployment mode tag

* update .env

* just log if something goes wrong

* Use StateMessageHelper in source (#14125)

* Use StateMessageHelper in source

* PR feedback and formatting

* More PR feedback

* Revert change

* Revert changes

* Bump Airbyte version from 0.39.24-alpha to 0.39.25-alpha (#14124)

Co-authored-by: brianjlai <brianjlai@users.noreply.github.com>

* Refactor acceptance tests and utils (#13950)

* Refactor Basic acceptance tests and utils

* Refactor Advanced acceptance tests and utils

* Remove unused code

* Clear destination db data during cleanup

* Cleanup comments

* cleanup init code

* test creating new desintation db for each test

* cleanup desintation db init

* Allow to edit api client

* pull in temporal cloud changes

* Rename helper to harness; set some funcs to private; turn init into constructor

* add func to set env vars instead of using static vars and move some functionality out of init into acceptance tests

* update javadoc

Co-authored-by: Davin Chia <davinchia@gmail.com>

* fix javadoc formatting

* fix var naming

Co-authored-by: Davin Chia <davinchia@gmail.com>

* Bump Airbyte version from 0.39.25-alpha to 0.39.26-alpha (#14141)

Co-authored-by: terencecho <terencecho@users.noreply.github.com>

* 🎉 octavia-cli: Add ability to get existing resources (#13254)

* 13541 Fixed integration tests source-db2 Mac OS (#14133)

* 13523 Fix integration tests destination-cassandra Mac OS (#14134)

* 🐛 Source Hubspot: fixed SAT test, commented out expected_records (#14140)

* :bug: Source Intercom: extend `Contacts` schema with new properties (#14099)

* Source Twilio: adopt best practices (#14000)

* #1946 Source twilio: aopt best practices - tune tests

* #1946 add expected_records to acceptance-test-config.yml

* #1946 source twilio - upd schema and changelog

* #1946 fix expected_records

* #1946 source twilio: rm alerts from expected records as they expire in 30 days

* #1946 source twilio: bump version

* 🎉 Source BingAds:  expose hourly/daily/weekly/monthly options from configuration (#13801)

* #12489 - expose hourly/daily/weekly/monthly reports in discovery by default instead of in the connector's configuration settings

removed:  config settings for hourly/daily/weekly/monthly reports
added:    default value for all periodic reports to True

* #12489 - expose hourly/daily/weekly/monthly reports in discovery by default instead of in the connector's configuration settings

removed:  unused class variables, if-statement

* #12489 - expose hourly/daily/weekly/monthly reports in discovery by default instead of in the connector's configuration settings

removed:  unused variables from config

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* remove VersionMismatchServer (#14076)

* remove VersionMismatchServer

* remove VersionMismatchServerTest

* revert intended changes

* Increase instance termination time limit to 3 hours to accommodate connector builds. (#14181)

* Use correct bash comment symbol. (#14183)

* 🎉 New Source: Orbit.love (#13390)

* source-orbit: add definition and specs (#14189)

* 🎉 Base Norrmalization: clean-up Redshift `tmp_schemas` after SAT (#14015)

Now after `base-normalization` SAT the Destination Redshift will be automatically cleaned up from test leftovers. Other destinations are not covered yet.

* Source Salesforce: fix customIntegrationTest for SAT (#14172)

* Source Amazon Ads: increase timeout for SAT (#14167)

* 🎉  Introduce Google Analytics Data API source (#12701)

* Introduce Google Analytics Data API source

https://developers.google.com/analytics/devguides/reporting/data/v1

* Add Google Analytics Data API source PR link

* Add `client` class for Google Analytics Data API

* Move dimensions and metrics extraction to the `client` class

In the Google Analytics Data API

* Change the copyright date to 2022 in Google Analytics Data API

* fix: removing incremental syncs

* fix: change project_id to string

* fix: flake check is failing

* chore: added it to source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>

* 🐛 Destination Redshift: use s3 bucket path for s3 staging operations (#13916)

* Publish acceptance test utils maven artifact (#14142)

* Fix StatePersistence Legacy read/write (#14129)

StatePersistence will wrap/unwrap legacy state on write/read to ensure
compatibility with the old behavior/data.

* 🎉 Destination connectors: Improved "SecondSync" checks in Standard Destination Acceptance tests (#14184)

* [11731] Improved "SecondSync" checks in Standard Destination Acceptance tests

* 🐛 Source Zendesk Support: fixed "Retry-After" non integer value (#14112)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Source Tiktok Marketing: Videometrics (#13650)

* added video metrics in streams.py

* common metrics list updated.

* updated streams.py with extended metrics required.

* updated stream_test

* updated configured_catalog

* video metrics required list updated.

* chore: formatting

* chore: bump version in source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>

* 🎉 Source Github: secondary rate limits has to retry (#13955)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Harshith/test pr 13118 (#14192)

* Firebolt destination

* feat: Write method dropdown

* feat: Use future-proof Auth in SDK

* refactor: Move writer instantiation

* fix: tests are failing

* fix: tests are failing

* fix: tests are failing

* chore: added connector to definitions

* fix: formatting and spec

* fix: formatting for orbit

Co-authored-by: ptiurin <petro.tiurin@firebolt.io>

* 🪟 :art: Show credit usage on chart's specific day (#13503)

* add tooltip to chart

* Fixes:
- update main chart color;
- change onHover background color

* change chart color pallet to grey 500

* update color reference

* remove opacity from UsageCell

* 🐛 destination-redshift: use s3 bucket path for s3 cleanup (#14190)

* Improve documentation for Postgres Source (#13830)

* Improve documentation for Postgres Source
 * add information about additional JDBC params
 * add anchors for doc sections
 * fix link to CDC on Bare Metal
 * add more details about parsing date/time values
 * add doc link to SSH fields

* Handle null reset source config (#14202)

* handle null reset source config

* format

* Wait indefinitely if connection is not active (#14200)

* also wait indefinitely if connection is deleted

* fix test

* Bump Airbyte version from 0.39.26-alpha to 0.39.27-alpha (#14204)

Co-authored-by: lmossman <lmossman@users.noreply.github.com>

* Bmoric/feature flag for state deserialization (#14127)

* Add Feature flag

* Add default feature flag value

* Update test

* remove unsused

* tmp

* Update tests

* rm unwanted change

* PR comments

* [low-code connectors] default types and default values (#14004)

* default types and default values

* cleanup

* fixes so read works

* remove prints and trycatch

* comment

* remove unused param

* split file

* extract method

* extract methods

* comment

* optional

* fix test

* cleanup

* delete interpolated request header provider

* simplify next page url paginator interface

* comment

* format

* add state type endpoint (#14111)

* Bump Airbyte version from 0.39.27-alpha to 0.39.28-alpha (#14210)

Co-authored-by: sherifnada <sherifnada@users.noreply.github.com>

* 🐛 source-orbit: remove workspace_old.json (#14208)

* Fix: Docs plural login redirecting to wrong URL (#14207)

* [docs] fix numbering and incorrect filename in CDK docs (#13045)

* [docs] fix numbering in CDK docs

* Update 5-declare-schema.md

* Update 5-declare-schema.md

* Update 6-read-data.md

* Update 8-test-your-connector.md

* Remove the old scheduler from HelmCharts helper (#14187)

* Remove the old scheduler from HelmCharts helper

The old scheduler was removed as part of https://github.com/airbytehq/airbyte/pull/13400

* Remove legacy `scheduler` comment in HelmCharts

* Source Gitlab: add GroupIssueBoards stream (#13252)

* GitLab Source: add GroupIssueBoards stream

* Address stream schema comments

* Address comments

* Bump version

* Add as empty stream

* run seed file source (#14215)

* fix 'cannot reach server' error on demo instance (#10020)

* Update CODEOWNERS (#14209)

* 🎉 Source Github: use GraphQL for `reviews` stream (#13989)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* workflow for publishing artifacts for cloud (#14199)

* fix sentry org slug change (#14218)

* Source File: correct spec json to match json format (#13738)

* Upgrade spotless version and remove jvmargs workaround (#13705)

* Source Zendesk Chat: Process large amount of data in batches for incremental  (#14214)

* increased the limit of itens in request

* Configuration for max api pages on requests

* included api_pagination_limit in sample

* included api_pagination_limit in invalid_config

* creating new table for chat_session

* reverted api_pagination_limit approach

* removed api_pagination_limit from TimeIncrementalStream

* correct chat json

* bump connector version

* add changelog

* run format

* auto-bump connector version

Co-authored-by: Roberto Bonnet <robertojuarezwp@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Remove all @ts-ignore (#14221)

* Bump hadoop to use version 3.3.3 (#14182)

* Change the persistence activity to use the new persistence layer (#14205)

* Change the persistence activity to use the new persistence layer

* Use lombok

* format

* Use new State message helper

* Fix build (#14225)

* Fix build

* Fix test

* Use new state persistence for state reads (#14126)

* Inject StatePersistence into DefaultJobCreator
* Read the state from StatePersistence instead of ConfigRepository
* Add a conversion helper to convert StateWrapper to State
* Remove unused ConfigRepository.getConnectionState

* Temporal per stream resets (#13990)

* remove reset flags from workflow state + refactor

* bring back cancelledForReset, since we need to distinguish between that case and a normal cancel

* delete reset job streams on cancel or success

* extract isResetJob to method

* merge with master

* set sync modes on streams in reset job correctly

* format

* Add test for getAllStreamsForConnection

* fix tests

* update more tests

* add StreamResetActivityTests

* fix tests for default job creator

* remove outdated comment

* remove debug lines

* remove unused enum value

* fix tests

* fix constant equals ordering

* make job mock not static

* DRY and add comments

* add comment about deleted streams

* Remove io.airbyte.config.StreamDescriptor

* regisster stream reset activity impl

* refetch connection workflow when checking job id, since it may have been restarted

* only cancel if workflow is running, to allow reset signal to always succeed even if batched with a workflow start

* fix reset signal to use new doneWaiting workflow state prop

* try to fix tests

* fix reset cancel case

* add acceptance test for resetting while sync is running

* format

* fix new acceptance test

* lower sleep on test

* raise sleep

* increase sleep and timeout, and remove repeated test

* use CatalogHelpers to extract stream descriptors

* raise sleep and timeout to prevent transient failures

* format

Co-authored-by: alovew <anne@airbyte.io>

Co-authored-by: Luis Gomez <781929+lgomezm@users.noreply.github.com>
Co-authored-by: Jimmy Ma <gosusnp@users.noreply.github.com>
Co-authored-by: Amruta Ranade <11484018+Amruta-Ranade@users.noreply.github.com>
Co-authored-by: Topher Lubaway <asimplechris@gmail.com>
Co-authored-by: Malik Diarra <malik@airbyte.io>
Co-authored-by: Teal Larson <LARSON.TEAL@GMAIL.COM>
Co-authored-by: Tim Roes <tim@airbyte.io>
Co-authored-by: Benoit Moriceau <benoit@airbyte.io>
Co-authored-by: Lake Mossman <lake@airbyte.io>
Co-authored-by: VitaliiMaltsev <39538064+VitaliiMaltsev@users.noreply.github.com>
Co-authored-by: grishick <greg@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Greg Solovyev <grishick@users.noreply.github.com>
Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: Andy <andy@airbyte.io>
Co-authored-by: LiRen Tu <tuliren.git@outlook.com>
Co-authored-by: oneshcheret <33333155+sashaNeshcheret@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Xiaohan Song <xiaohan@airbyte.io>
Co-authored-by: Augustin <augustin.lafanechere@gmail.com>
Co-authored-by: Octavia Squidington III <90398440+octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
Co-authored-by: Charles <charles@airbyte.io>
Co-authored-by: Sophia Wiley <106352739+sophia-wiley@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Denis Davydov <davydov.den18@gmail.com>
Co-authored-by: Subodh Kant Chaturvedi <subodh1810@gmail.com>
Co-authored-by: Bastien Gandouet <bastien@mozaiqu.es>
Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
Co-authored-by: Paweł Kociński <pawel93kocinski@gmail.com>
Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Baz <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>
Co-authored-by: Alexander Marquardt <alexander.marquardt@gmail.com>
Co-authored-by: edgao <edgao@users.noreply.github.com>
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
Co-authored-by: George Claireaux <george@claireaux.co.uk>
Co-authored-by: mutt-santiago-stachuk <106173005+mutt-santiago-stachuk@users.noreply.github.com>
Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Arsen Losenko <20901439+arsenlosenko@users.noreply.github.com>
Co-authored-by: Petro Tiurin <93913847+ptiurin@users.noreply.github.com>
Co-authored-by: ptiurin <petro.tiurin@firebolt.io>
Co-authored-by: Andrii Leonets <30464745+DoNotPanicUA@users.noreply.github.com>
Co-authored-by: Jonathan Pearlin <jonathan@airbyte.io>
Co-authored-by: Jimmy Ma <jimmy@airbyte.io>
Co-authored-by: Ganpat Agarwal <gagarwal@artica.com>
Co-authored-by: Rajakavitha Kodhandapani <krajakavitha@gmail.com>
Co-authored-by: Yevhen Sukhomud <suhomud@gmail.com>
Co-authored-by: sw-yx <shawnthe1@gmail.com>
Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>
Co-authored-by: Eugene <etsybaev@gmail.com>
Co-authored-by: Anna Lvova <37615075+annalvova05@users.noreply.github.com>
Co-authored-by: Vladimir <volodymyr.s.petrov@globallogic.com>
Co-authored-by: Phlair <Phlair@users.noreply.github.com>
Co-authored-by: Parker Mossman <parker@airbyte.io>
Co-authored-by: Adam <adam-bloom@users.noreply.github.com>
Co-authored-by: Liren Tu <tuliren@gmail.com>
Co-authored-by: pmossman <pmossman@users.noreply.github.com>
Co-authored-by: Brian Lai <51336873+brianjlai@users.noreply.github.com>
Co-authored-by: Peter Hu <peter@airbyte.io>
Co-authored-by: Tuhai Maksym <kimerinn@gmail.com>
Co-authored-by: sajarin <sajarindider@gmail.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: steve withington <steve@digitalmine.com>
Co-authored-by: Leo Sussan <leosussan@gmail.com>
Co-authored-by: cenegd <cenegd@live.com>
Co-authored-by: Tomas Perez Alvarez <72174660+Tomperez98@users.noreply.github.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Co-authored-by: Yurii Bidiuk <yura.bidyuk@gmail.com>
Co-authored-by: Christophe Duong <christophe.duong@gmail.com>
Co-authored-by: jdpgrailsdev <jdpgrailsdev@users.noreply.github.com>
Co-authored-by: Stella Chung <schung507@gmail.com>
Co-authored-by: Amanda Murphy <amanda.murphy@heapanalytics.com>
Co-authored-by: Mohamed Magdy <mohamed.magdy@canary.is>
Co-authored-by: nataly <nataly@airbyte.io>
Co-authored-by: Tyler Russell <tylerrussell85@gmail.com>
Co-authored-by: Alexander Tsukanov <alexander.tsukanovvv@gmail.com>
Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
Co-authored-by: brianjlai <brianjlai@users.noreply.github.com>
Co-authored-by: terencecho <terence@airbyte.io>
Co-authored-by: terencecho <terencecho@users.noreply.github.com>
Co-authored-by: Daniel Diamond <33811744+danieldiamond@users.noreply.github.com>
Co-authored-by: drrest <dr.rest@gmail.com>
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
Co-authored-by: Zawar Khan <zawar.khan@getmercury.io>
Co-authored-by: sherifnada <sherifnada@users.noreply.github.com>
Co-authored-by: Sachin Jangid <sachinjangid832@gmail.com>
Co-authored-by: Chris Wu <chris@faros.ai>
Co-authored-by: Jared Rhizor <me@jaredrhizor.com>
Co-authored-by: tison <wander4096@gmail.com>
Co-authored-by: Roberto Bonnet <robertojuarezwp@gmail.com>
Co-authored-by: alovew <anne@airbyte.io>
pdulapalli added a commit to falkonai/airbyte that referenced this pull request Jun 29, 2022
@pdulapalli @supertopher
@malikdiarra @teallarson @timroes @benmoriceau @lmossman @VitaliiMaltsev @octavia-squidington-iii @grishick @evantahler @girarda @tuliren @sashaNeshcheret @marcosmarxm @xiaohansong @alafanechere @cgardens @gosusnp @sophia-wiley @edgao @davydov-d @subodh1810 @b4stien @harshithmullapudi @Imbruced @grubberr @bazarnov @edmundito @Amruta-Ranade @alexander-marquardt @Phlair @mutt-santiago-stachuk @davinchia @arsenlosenko @ptiurin @DoNotPanicUA @jdpgrailsdev @ganpatagarwal @Rajakavitha1 @suhomud @swyxio @etsybaev @annalvova05 @dizel852 @pmossman @adam-bloom @brianjlai @git-phu @kimerinn @sajarin @stevewithington @leosussan @ss098 @Tomperez98 @sherifnada @yurii-bidiuk @ChristopheDuong @schung507 @mohamagdy @terussell85 @alexandertsukanov @pedroslopez @terencecho @danieldiamond @drrest @avaidyanatha @Zawar92 @gittysachin @cjwooo @jrhizor @tisonkun @RobertoBonnet @alovew
Log marketo response errors (#10)
e8877d5 
* Adds zombie removal tool (#13718)

* Adds zombie removal tool

* Corrects endpoint adds comments

* Adds API links

* Changes search logic, fixes escape character

* Corrects help text

* Fix connection read object building (#13568)

Make sure the sourceCatalogId field is set with the value stored in the
database.

* fix modal overlay problem (#13724)

* Improve Gradle build and fix storybook (#13719)

* Improve Gradle build and fix storybook

* Run all copy tasks after copyDocker

* fix stream descriptor typo (#13726)

* Save streams to reset in job config when creating reset job (#13703)

* save streams to reset in job config when creating reset job

* change streamDescriptors to streamsToReset

* :bug: Postgres Source: fixed unsupported date-time datatypes during incremental sync (#13655)

* Postgres Source: fixed unsupposted date-time datatypes during incremental sync

* updated CHANGELOG

* add tests for incremental cursor check

* removed star import

* Postgres Source: fixed unsupposted date-time datatypes during incremental sync

* updated CHANGELOG

* add tests for incremental cursor check

* removed star import

* add timestamp datatype test

* Bump version in Dockerfile

* auto-bump connector version

Co-authored-by: grishick <greg@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Bump version in Dockerfile to match source-postgres version (#13732)

* Fail the connection state instead of throwing an exception (#13728)

* Fail the connection state instead of throwin exception

* Fix test

* rm import

* Update airbyte-workers/src/main/java/io/airbyte/workers/general/DefaultCheckConnectionWorker.java

Co-authored-by: Evan Tahler <evan@airbyte.io>

Co-authored-by: Evan Tahler <evan@airbyte.io>

* [low-code connectors] add a few unit tests (#13666)

* add a couple of unit tests

* refactor tests

* 🎉 Destination databricks: rename to databricks lakehouse (#13722)

* Update Databricks naming

* Update destination_spec

* Update BOOTSTRAP.md

* Update Dockerfile

* Update README.md

* Update spec.json

* Update databricks.md

* Update databricks.md

* Update airbyte-integrations/connectors/destination-databricks/BOOTSTRAP.md

Co-authored-by: LiRen Tu <tuliren.git@outlook.com>

Co-authored-by: LiRen Tu <tuliren.git@outlook.com>

* Fallback to parsing datetime and time strings w/ and w/o timezones in case DateTimeParseException is thrown (#13745)

* Fall back to parsing w/ or w/o TZ if parsing a date or a time string fails
* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Bump source-postgres-strict-encrypt version to 0.4.23 to match source-postgres version (#13747)

* S3 and GCS destinations: Updating processing data types for Avro/Parquet formats (#13483)

* S3 destination: Updating processing data types for Avro/Parquet formats

* S3 destination: handle comparing data types

* S3 destination: clean code

* S3 destination: clean code

* S3 destination: handle case with unexpected json schema type

* S3 destination: clean code

* S3 destination: Extract the same logic for Avro/Parquet formats to separate parent class

* S3 destination: clean code

* S3 destination: clean code

* GCS destination: Update data types processing for Avro/Parquet formats

* GCS destination: clean redundant code

* S3 destination: handle case with numbers inside array

* S3 destination: clean code

* S3 destination: add unit test

* S3 destination: update unit test cases with number types.

* S3 destination: update unit tests.

* S3 destination: bump version for s3 and gcs

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Source Salesforce: fix sync capped streams with more records than page size (#13658)

* change logic for counting records

* update doc

* correct unit test

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Docs: update normalization doc (#13739)

* update dbt version in custom normalization (#13742)

* Kube fix and Docs for open telemetry integration (#13701)

* Create interface, factory for metric client

* remove unused func

* change count val to use long

* PR fix

* otel metric client implementation

* merge conflicts resolve

* build fix

* add a test, moved version into deps catalog

* fix test

* add docs for open telemetry

* fix kube setting for otel, and add doc

* helm related fields update for opentel

* cdk: fix typo in build.gradle.hbs (#13761)

* Bump Airbyte version from 0.39.17-alpha to 0.39.18-alpha (#13759)

Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
Co-authored-by: Benoit Moriceau <benoit@airbyte.io>

* Update destinations to handle new state messages (#13670)

* 🐛 Postgres Source: fixed truncated precision if the value of the milliseconds or seconds is 0 (#13549)

* Postgres Source: fixed truncated precision if the value of the millisecond or second is 0

* check CI with 1.15.3 testcontainer

* check CI with 1.15.3 testcontainer

* returned latest version of testcontainer

* fixed checkstyle

* fixed checkstyle

* returned latest testcontainer version

* updated CHANGELOG

* bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Postgres source strict encrypt trucnated precision bump version (#13769)

* Postgres Source: fixed truncated precision if the value of the millisecond or second is 0

* check CI with 1.15.3 testcontainer

* check CI with 1.15.3 testcontainer

* returned latest version of testcontainer

* fixed checkstyle

* fixed checkstyle

* returned latest testcontainer version

* updated CHANGELOG

* bump version

* auto-bump connector version

* Postgres source strict encrypt bump version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Migrate StateDB to support per stream states (#13731)

* Update StateDB to support per Stream states.
* Add `StateType` type
* Add `steam_name`, `namespace` and `type` to `state` table.
* Set the default StateType to LEGACY

* Update getting-started-with-airbyte-cloud.md (#13741)

* Update getting-started-with-airbyte-cloud.md

Edited Getting Started with Airbyte Cloud guide to match the updated Cloud UI.

* Update getting-started-with-airbyte-cloud.md

Updated based on Amruta's suggestions.

* 🐛  Normalization correctly propagates deletions to the final tables (#12846)

* Update Airbyte Protocol Docs (#13709)

* Source Facebook marketing: fix `not syncing any data` issue (#13749)

* #253 oncall source fb marketing: fix  issue

* #253 oncall: upd changelog

* Update docs/integrations/sources/facebook-marketing.md

* auto-bump connector version

Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Ignore custom connectors during connectors update (#13581)

* Ignore Custom connectors during connectors update

* Skip any connector flagged as custom as well

* Format

* [low-code connectors] Support for list-based stream slicers (#13668)

* list slicer

* Add comment

* test

* ast eval

* refactor

* fix

* remove print

* rename

* return a generator

* smaller fix and reset to master

* union type hint

* assert

* comment

* format

* 📝 Postgres source: add troubleshooting for postgres hot standby (#13784)

* Add troubleshooting section in postgres doc

* Update doc

* Add one more solution

* upgrade debezium version for postgres to 1.9.2 (#13368)

* upgrade debezium version for postgres to 1.9.2

* fix test+build

* fix build

* address review comments

* update link to docs

* fix test

* 🐛 Source Amplitude: Fix an infinite loop (#13638)

* Fix infinite loop when fetching Amplitude data

* Update changelog and version

* Address review

* fix: unit tests were failing

* chore: bump version in source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>

* octavia-cli: allow user to set custom API HTTP headers(#12893)

* 🎉 Source Github: Fix API sorting, fix `get_starting_point` caching (#13707)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* 🐛 Source Zendesk Support: fixed 429 error for `TicketMetrics` stream (#13757)

* Add some dev-facing normalization docs (#13780)

* Fix mysql cdc acceptance test (#13795)

* fix mysql cdc acceptance test

* remove comments

* doc: add link to forum in plopfile (#13560)

* Make connector adaptable based on deployment mode (#13522)

* Add deployment mode to env shared with jobs

* Add adaptive runners

* Migrate postgres source to use adaptive runner

* Add an array of specs in docker image spec definition

* Add copyright

* Parse docker image spec with specs list

* Update spec yaml files

* Pass in DEPLOYMENT_MODE to docker compose file

* Revert "Parse docker image spec with specs list"

This reverts commit 8fe41dd3b7fa5306ba8b62d660c002420adb9b23.

* Revert changes in docker image spec

* Read cloud specific spec files based on deployment mode

* Revert "Update spec yaml files"

This reverts commit 059f326432dba1f8da4ad4dfd8d5ac7a14de66c3.

* Publish cloud spec file if necessary

* Fix upload script

* Move test files

* Update docker compose file

* Format code

* Add comment about spec filename

* Add unit tests

* Remove redundant jdbc acceptance test

When running `PostgresStrictEncryptJdbcSourceAcceptanceTest`, the `discover` method tests always fail because there are unexpected columns in the catalog:
- `wakeup_at`
- `last_visited_at`
- `last_comment_at`

These columns only exist in `PostgresJdbcSourceAcceptanceTest`. And this failure cannot be reproduced locally.

The hypothesis is that when the JDBC unit tests are run on CI, they are run in parallel, and the same testcontainer is used for both tests. That's why the strict encrypt test can discover columns from the oridinary unit test.

Given that the JDBC strict encrypt test is basically redundant, it is removed.

* Update color palette, add scss colors, borders, and spacing (#13802)

* Add updated color palette to SCSS and theme
* Migrate current color palette to new colors

* Add border and spacing variables

* Remove legacy color mapping from scss side

* Add style guide to front end repo (#13418)

* Add .md from google doc draft

* update per review

* cleanup

* Update STYLEGUIDE.md

Co-authored-by: Tim Roes <tim@airbyte.io>

* Edited Stripe, HubSpot, Intercom docs (#13810)

* Initial edits

* Updated the Stripe connector doc

* Updated the Stripe doc

* Updated HubSpot and Intercom docs

* Minor sidebar edit

* Remove the catalog from the sidebar since the file has been deleted in Update Airbyte Protocol Docs (#13709) (#13813)

* Fix broken link (#13815)

* fixing broken links

* docusaurus updates

* Add METRIC_CLIENT and OTEL_COLLECTOR_ENDPOINT to .env files to fix kube deployments (#13817)

* octavia-cli: per workspace state (#13070)

* Fix LabeledSwitch component width (#13798)

* Fix LabeledSwitch component width

* Switch to new color palette

* Replace color

* Fix color variable

* Update 4-connection-checking.md (#13812)

* Update 4-connection-checking.md

As discussed in https://airbytehq-team.slack.com/archives/C02UQ9MJ4GG/p1655312684160609 - this example is misleading, as it does not actually connect to any API to validate connectivity.

* Update 4-connection-checking.md

Added a link to OneSignal check_connection, and move the "Note" to below the example

* Bump Airbyte version from 0.39.18-alpha to 0.39.19-alpha (#13820)

Co-authored-by: edgao <edgao@users.noreply.github.com>

* Normalization: Upgrade MySQL to dbt 1.0.0 (#11470)

* Restart workflow after activity failure instead of quarantining (#13779)

* use SHORT_ACTIVITY_OPTIONS on check connection activity so that it has retries

* retry workflow after delay instead of quarantining

* allow activity env vars to be configured in docker and kube

* add env var for workflow restart delay and refactor slightly

* update tests to handle new restart behavior

* update test name

* add empty env var values to .env files

* fail attempt before job in cleanJobState to prevent state machine failure

* change default value of max activity attempt retries from 10 to 5

* Bump Airbyte version from 0.39.19-alpha to 0.39.20-alpha (#13829)

Co-authored-by: lmossman <lmossman@users.noreply.github.com>

* 🎉 Postgres source: prepare for removing strict-encrypt variant (#13823)

* Bump postgres version

* Update doc

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* update readme (#13836)

* add evan, jonathan, charles as protocol reviews in codeowners (#13776)

* 📚 update MSSQL docs to reflect that we support normalization (#13826)

* [low-code connectors] Cartesian product stream slicer (#13740)

* list slicer

* Add comment

* product stream slicer

* comment

* rename

* format

* Update comment

* split on 2 lines for readability

* Revert "rename"

This reverts commit e801f2d1f859306c6a2b0d66d265753ee9e32a54.

* updated stacktrace format in java trace messages (#13847)

* updated stacktrace format in java trace messages

* test checks specifically on stacktrace in trace message

* remove unused import

* source-facebook-marketing: 🎉 Add fields to the ads_set stream (#13623)

* 🎉 Source Github: use GraphQL for `pull_request_stats` stream (#13763)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Tweak schema validation code for readability. (#13721)

* Refactor schema validation for better reading.

* Better comments.

* Format.

* source-facebook-marketing: bump to 0.2.53 (#13853)

* Source Hubspot - fix missing data issue (#13837)

* #278 oncall: source hubspot - fix missing data issue

* #278 oncall: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Source Amplitude: try-catch BadZipFile exception (#13846)

* #272 oncall: source Amplitude - try-catch BadZipFile exception

* #272-oncall: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* 🐛 Server can display streams with the same name in different namespaces (#13855)

* Updated connector catalog (#13862)

* Fix the running job counter (#13833)

* Add StateType and StateWrapper objects to the model (#13858)

* Emit orphan running jobs metrics (#13865)

That metrics show the number of jobs currently flagged as running that
are associated to inactive or deprecated connections.

* Add meaningful tests for OTEL client (#13831)

* Add meaningful tests for OTEL client

* PR comment fix

* code clean ups

* Persist state to reset connection job config (#13867)

* add current connection state to JobResetConnectionConfig

* pass state from reset connection config to job sync config in generate input activity

* format

* Source Google Analytics: Add threshold_days option, uncomment statement for incremental tests (#13871)

* Harshith/test pr 12536 (#13874)

* 🎉 New Source: Firebolt (#1)

* fix: Boolean type cast

* test: Improve format testing and doc

* refactor: Move some db functionality

* docs: Adding types doc link in utils

* feat: Use future-proof Auth in SDK

* fix: integration tests are failing

* chore: update seed file

Co-authored-by: Petro Tiurin <93913847+ptiurin@users.noreply.github.com>
Co-authored-by: ptiurin <petro.tiurin@firebolt.io>

* :bug: Source Relational DB : remove unicode nulls from cursors (#13854)

* Make sure that cursor value doesn't contain unicode null.

* Test that cursors doesn't contain unicode null

* incr version

* enableReinitialize on account form (#13622)

* #13888 source instagram: fix build (#13889)

* Fix md and lg spacing scss vars (#13886)

* Publishing java connectors with better formatted stacktrace in Trace messages (#13852)

* start

* revert

* azblob

* bq

* bq denorm

* megapublish baaaabyyyy

* fix needs

* matrix connectors

* auto-bump connector version

* dont failfast and max parallel 5

* multi runno

* minor

* testing matrix agents

* name

* testing multi agents

* tmp fix

* new multi agents

* multi test

* tryy

* let's do this

* magico

* fix

* label test

* couple more connector bumps

* temp

* things

* check this

* lets gooo

* more connectors

* Fix md and lg spacing scss vars (#13886)

* Delete TEMP-testing-command.yml

* auto-bump connector version

* Delete publish-command.yml

* added comment describing bash part

* running single thread

* catch sentry cli

* auto-bump connector version

* Update _variables.scss

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* octavia-cli: fix workspace not having anonymous_data_collection property (#13869)

* Update connection update calls to use central utility to ensure connection update has all data (#13564)

* Update connection updates with build update utility
* Add buildConnectionUpdate utility
* Update components that update the connection to use utility when necessary

* Use conection name when saving connection from replication view to prevent override from refreshed catalog

* Improve connection check on ReplicationView onSubmit function

* Display connection state in connection setting page (#13394)

* Display Connection State in Setting page

* memoize callback

* rendering and confirmaton

* setState API

* Input validation

* remove JSON step

* rename apiMethod to `updateState`

* test and adjust route

* skip if sync is running

* prevent state update when sync is running

* code editor component

* errors fixed

* scss style

* make linter happy

* Back to monaco editor

* Remove ability to edit state

* Adjust FE code

* Fix CSS problem

* Update airbyte-webapp/src/locales/en.json

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* just use PRE to render state for now

Co-authored-by: Tim Roes <tim@airbyte.io>
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* update api for per stream (#13835)

* Update airbyte-protocol.md (#13892)

* Update airbyte-protocol.md

* Fix typo

* Fix prose

* Add protocol reviewers for protocol documentation

* Remove duplicate

* Edited Amplitude, Mailchimp, and Zendesk Support docs (#13897)

* deleting SUMMARY.md since we don't need it for docusaurus builds (#13901)

* Do not hide unexpected errors in the check connection (#13903)

* Do not hide unexpected errors in the check connection

* Fix test

* Common code to deserialize a state message in the new format (#13772)

* Common code to deserialize a state message in the new format

* PR comments and type changed to typed

* Format

* Add StateType and StateWrapper objects to the model

* Use state wrapper instead of Either

* Switch to optional

* PR comments

* Support array legacy state

* format

Co-authored-by: Jimmy Ma <jimmy@airbyte.io>

* 🐛 Source Amazon Seller Partner: handle start date for financial stream (#13633)

* start and end date for finacial stream should not be more than 180 days apart

* improve unit tests

* make changes to start date for finance stream

* update tests

* lint changes

* update version to 0.2.22 for source-amazon-seller-partner

* Normalization: Fix incorrect jinja2 macro `json_extract_array` call (#13894)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Docs: fixed the broken links (#13915)

* 0.2.5 -> 0.2.6 (#13924)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* 13546 Fix integration tests source-postgres Mac OS (#13872)

* 13546 Fix integration tests source-postgres Mac OS

* 13548 Fixed integration tests source-tidb Mac OS (#13927)

* Source MsSql : incr ver to include changes #13854 (#13887)

* incr version

* put PR id

* docker ver

* connectors that published (#13932)

* Deprecate PART_SIZE_MB in connectors using S3/GCS storage (#13753)

* Removed part_size from connectors that use StreamTransferManager

* fixed S3DestinationConfigTest

* fixed S3JsonlFormatConfigTest

* upadate changelog and bump version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* upadate changelog and bump version for Redshift and Snowflake destinations

* auto-bump connector version

* fix GCS staging test

* fix GCS staging test

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Reverted changes in SshBastionContainer (#13934)

* 🎉 New Source Dockerhub (#13931)

* init

* implement working source + tests

* add docs

* add docs

* fix bad comments

* Update airbyte-integrations/connectors/source-dockerhub/acceptance-test-config.yml

* Update airbyte-integrations/connectors/source-dockerhub/Dockerfile

* Update airbyte-integrations/connectors/source-dockerhub/.dockerignore

* Apply suggestions from code review

* Update docs/integrations/sources/dockerhub.md

* Update airbyte-integrations/connectors/source-dockerhub/integration_tests/acceptance.py

Co-authored-by: George Claireaux <george@airbyte.io>

* address @Phlair's feedback

* address @Phlair's feedback

* each record is now a Docker image rather than response page

* format

* fix unit tests

* fix acceptance tests

* add icon, definition and generate seed spec

* add requests to requirements

Co-authored-by: sw-yx <shawnthe1@gmail.com>

* commented out non-relevant tests (#13940)

* Bump Airbyte version from 0.39.20-alpha to 0.39.21-alpha (#13938)

Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>

* newaction (#13942)

* remove test action (#13944)

* 🎉Source-mysql: aligned datatype test (#13945)

* [13607] source-mysql: aligned datatype tests for regular and CDC ways + added CHAR fix to CDC processing

* #13958 Source Stripe: fix configured catalogs (#13959)

* 🐛 Source: Typeform - Update schema for Responses stream (#13935)

* Upd responses schema

* Upd docs

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* :window: Updated email invitation flow that enables invited users to set name and create password (#12788)

* First pass accepting email link invitation
* Update Auth service with signInWithEmailLink calls
* Add AcceptEmailInvite component
* Update FirebaseActionRoute to handle sign in mode
* Rename ResetPasswordAction to FirebseActionRoute

* Add create password setp to AcceptEmailInvite component

* Remove continueURL from invite fetch

* Update accept email invite for user to enter both email and password together

* Set name during email link signup

* Update AcceptEmailInvite to send name
* Add updateName to UserService
* Update AuthService to set name during sign up

* Remove steps from AcceptEmailInvite component
Remove setPassword from AuthService

* Add header and title to accept invite page

* Move invite error messages to en file

* For invite link pages, show login link instead of sign up

* Disable name update on sign in via email lnk

* Resend email invite when the invite link is expired

* Fix status message in accept email invite page

* Re-enable set user's name during sign up email invite

* Update signUpWithEmailLink so that sign up is successful even if we fail to update the user's name

* Update comments on GoogleAuthService signInWithEmailLink

* Add newsletter and accept terms checkboxes to accept email invite component
* Extract signup form from signup page
* Extract fields from signup form
* Update accept email invite component to use field components from signup form
* Ensure that sign up button is disable until form is valid and security checkbox is checked

* Make error status text color in accept email link red

* Update workspace check in DefaultView so that user lands in workspace selector when there are no workspaces

* Add coment around continueUrl param usage in UserService

* Remove usless default case in GoogleAuthService

* Source Marketo: process fail during creation of an export job (#13930)

* #9322 source Marketo: process fail during creation of an export job

* #9322 source marketo: upd changelog

* #9322 source marketo: fix unit test

* #9322 source marketo: fix SATs

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* :window: :wrench: Add eslint rules for CSS modules (#13952)

* add eslint-plugin-css-modules rules

* Fixes:
- turn on eslint css modules rule as error
- remove unused styles

* add warning message if styled components is used

* Revert "add warning message if styled components is used"

This reverts commit 4e92b8b2110142bb679f15aeb034e377e0dcc69c.

* replace rule severity with words

* Update salesforce.md

Fixed broken link

* :window: 🔧 Add auto-fixable linting rules to webapp (#13462)

* Add new eslint rules that fit with our code style and downgrade rules to warn

* allowExpressions in fragment eslint rule

* Enable function-component-definition in eslint and fix styles

* Cleanup lint file

* Fix react/function-component-definition warnings manually

* Add more auto-fixable rules and fix

* Fix functions that require usless returns

* Update array-type rule to array-simple

* Fix eslint errors manually
disable assignmentExpression for arrays in prefer-destructuring rule

* Auto fix new linting issues after rebase

* Enhance /publish to allow for multiple connectors and parallel execution (#13864)

* start

* revert

* azblob

* bq

* bq denorm

* megapublish baaaabyyyy

* fix needs

* matrix connectors

* auto-bump connector version

* dont failfast and max parallel 5

* multi runno

* minor

* testing matrix agents

* name

* testing multi agents

* tmp fix

* new multi agents

* multi test

* tryy

* let's do this

* magico

* fix

* label test

* couple more connector bumps

* temp

* things

* check this

* lets gooo

* more connectors

* Delete TEMP-testing-command.yml

* auto-bump connector version

* added comment describing bash part

* running single thread

* catch sentry cli

* auto-bump connector version

* destinations

* + snowflake

* saved

* auto-bump connector version

* auto-bump connector version

* java source bumps

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* remove twice-defined methods

* label things

* revert action

* using the new test action

* point at action

* wrong tag on action

* update pool label

* update to use new ec2-github-runner fork

* this needs to be more generic than publisher

* change publish to run on pool

* add comment about runner-pool usage

* updated publish command docs for multi & parallel connector runs

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* unbump failed publish versions

* missed dockerfiles

* remove failed docs

* mssql fix

* overhauled the git comment output

* bumping a test connector that should work

* slight order switcheroo

* output connectors properly in first message

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Bump Airbyte version from 0.39.21-alpha to 0.39.22-alpha (#13979)

Co-authored-by: Phlair <Phlair@users.noreply.github.com>

* Parker/temporal cloud (#13243)

* switch to temporal cloud client for now

* format

* use client cert/key env secret instead of path to secret

* add TODO comments

* format

* add logging to debug timeout issue

* add more logging

* change workflow task timeout

* PR feedback: consolidate as much as possible, add missing javadoc

* fix acceptance test, needs to specify localhost

* add internal-use only comments

* format

* refactor to clean up TemporalClient and prepare it for future dependency injection framework

* remove extraneous log statements

* PR feedback

* fix test

* return isInitialized true in test

* 📄  Postgres source: fix CDC setup order in docs (#13949)

* postgres source: fix CDC setup order docs

* Update docs/integrations/sources/postgres.md

Co-authored-by: Liren Tu <tuliren@gmail.com>

* Per-stream state support for Postgres source (#13609)

* WIP Per-stream state support for Postgres source

* Fix failing test

* Improve code coverage

* Make global the default state manager

* Add legacy adapter state manager

* Formatting

* Include legacy state for backwards compatibility

* Add global state manager

* Implement Global/CDC state handling

* Fix test issues

* Fix issue with updated method signature

* Handle empty state case in global state manager

* Adjust to protocol changes

* Fix failing acceptance tests

* Fix failing test

* Fix unmodifiable list issue

* Fix unmodifiable exception

* PR feedback

* Abstract global state manager selection

* Handle conversion between different state types

* Handle invalid conversion

* Rename parameter

* Refactor state manager creation

* Fix failing tests

* Fix failing integration tests

* Add CDC test

* Fix failing integration test

* Revert change

* Fix failing integration test

* Use per-stream for postgres tests

* Formatting

* Correct stream descriptor validation

* Correct permalink

* PR feedback

* Bump Airbyte version from 0.39.22-alpha to 0.39.23-alpha (#13984)

Co-authored-by: pmossman <pmossman@users.noreply.github.com>

* Adds test for new workflow (#13986)

* Adds test for new workflow

* Adds airbyte repo

* remove testing line

* Add new InterpolatedRequestOptionsProvider that encapsulates all variations of request arguments (#13472)

* write out new request options provider and refactor components and parts of the YAML config

* fix formatting

* pr feedback to consolidate body_data_provider to simplify the code

* pr feedback get rid of extraneous optional

* publish oss for cloud (#13978)

workflow to publish oss artifacts that cloud needs to build against
use docker buildx to create arm images for local development

* skip debezium engine startup in case no table is in INCREMENTAL mode (#13870)

* 🎉 Source Github: break point added for workflows_runs stream (#13926)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* 6339: error when attempting to use azure sql database within an elastic pool as source for cdc based replication (#13866)

* 6339: debug info

* 6339: not using 'USE' on Azure SQL servers

* 6339: cleanup

* 6339: cleanup2

* 6339: cleanup3

* 6339: versions/changelogs updated

* 6339: merge from master (consolidation issue)

* 6339: dev connector version (for testing in airbyte cloud)

* 6339: code review implementation

* 6339: apply formatting

* in case runners fail to spin up, this needs to run on github-hosted (#13996)

* 12708: Add an option to use encryption with staging in Redshift Destination (#13675)

* 12708: Add an option to use encryption with staging in Redshift Destination

* 12708: docs/docker configs updated

* 12708: merge with master

* 12708: merge fix

* 12708: code review implementation

* 12708: fix for older configs

* 12708: fix for older configs in check

* 12708: merge from master (consolidation issue)

* 12708: versions updated

* :tada: New Source: Webflow (#13617)

* Added webflow code

* Updated readme

* Updated README

* Added webflow to source_definitions.yaml

* Enhanced documentation for the Webflow source connector

* Improved webflow source connector instructions

* Moved Site ID to before API token in Spec.yaml (for presentation in the UI)

* Addressed comments in PR.

* Changes to address requests in PR review

* Removed version from config

* Minor udpate to spec.yaml for clarity

* Updated to pass the accept-version as a constant rather than parameter

* Updated check_connection to hit the collections API that requires both site id and the authentication token.

* Fixed the test_check_connection to use the new check_connection function

* Added a streams test for generate_streams

* Re-named "autentication" object to "auth" to be more consistent with the way it is created by the CDK

* Added in an explict line to instantiante an "auth" object from WebflowTokenAuthenticator, to make it easier to describe in the blog

* Fixed a typo in a comment

* Renamed some classes to be more intuitive

* Renamed class to be more intuitive

* Minor change to an internal method name

* Made _get_collection_name_to_id_dict staticmethod

* Fixed a unit-test error that only appeared when running " python -m pytest -s unit_tests".
This was caused by Mocked settings from test_source.py leaking into test_streams.py

* format: add double quotes and remove unused import

* readme: remove semantic version naming of connector in build commands

* Updated spec.yaml

* auto-bump connector version

* format files

* add changelog

* update dockerfile

* auto-bump connector version

Co-authored-by: sajarin <sajarindider@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>

* Source-oracle: fixed tests + checkstyle (#13997)

* Source-oracle: fixed tests + checkstyle

* 🐛Destination-mysql: fixed integration test and build process (#13302)

* [13180] destination-mysql: fixed integration test

* update changelog to include debezium version upgrade (#13844)

* make table headers look less like successes (#13999)

* source-twilio: implement lookback windows (#13896)

* Revert "12708: Add an option to use encryption with staging in Redshift Destination (#13675)" (#14010)

This reverts commit aa28d448d820df9d79c2c0d06b38978d1108fb2c.

* Revert "6339: error when attempting to use azure sql database within an elastic pool as source for cdc based replication (#13866)" (#14011)

This reverts commit 0d870bd37bc3b5cd798b92115d73bcc45a42d8f7.

* [low-code connectors] BasicHttpAuthenticator (#13733)

* implement basichttpauthenticator

* add optional refresh access token authenticator

* remove prints

* type hints

* Fix and unit test

* missing test

* Add class to __init__ file

* Add comment

* migrate JsonSchemas to use basic path instead of JSONPath (#13917)

* scaffold for catalog diff, needs fixing on type handling and tests (#13786)

* Prepare release of JDBC connectors (#13987)

* Prepare release of JDBC connectors

* Update source definitions manually

* use built in check for if path is definite (#13834)

* 13535 Fixed bastion network for integration tests (#14007)

* doc: add error troubleshooting `docker-compose up` (#13765)

* fix: duplicate resource allocations in `airbyte-temporal` deployment (#13816)

* helm-chart: Fix worker deployment format error (#13839)

* add catalog diff connection read (#13918)

* doc: fix small typo on Shopify documentation (#13992)

* add streams to reset to job info (#13919)

* Generate api for changes in #13370 and make code compatible (#14014)

* Generate api for per-stream updates #13835 (#14021)

* Revert "Prepare release of JDBC connectors (#13987)" (#14029)

This reverts commit df759b30778082508e2872513800fac34d98ff7c.

* Fix per stream state protocol backward compatibility (#14032)

* rename state type field to fix backwards compatibility issue

* replace usages of stateType with type

* support semi incremental by adding extractor record filter (#13520)

* support semi incremental by adding extractor record filter

* refactor extractor into a record_selector that supports extraction and filtering of response records

* Remove pydantic spec from amazon ads and use YAML spec (#13988)

* add EdDSA support in SSH tunnel (#9494)

* add EdDSA support

* verify EdDSA support works correct

Co-authored-by: Yurii Bidiuk <yura.bidyuk@gmail.com>

* 🎉New source connector: source-metabase (#13752)

* Add docs

* Close metabase session when sync finishes

* Close session in check_connection

* Add source definition to seed

* Add icon

* improve cdc check for connectors (#14005)

* improve should use cdc check

* Revert "improve should use cdc check"

This reverts commit 7d01727279d21d33a6c18ed3227ee94432636120.

* improve should use cdc check

* add unit test

* Update webflow.md

* Update webflow.md

* Update webflow.md

* Remove legacy sentry code from cdk (#14016)

* rip sentry out of cdk

* remove sentry dsn from gsc

* Update webflow.md

* Update webflow.md

* Fixed broken links (#14071)

* 🪟Persist unsaved changes on schema refresh (#13895)

* add form values tracker context

* add clarifying comment

* add same functionality to create connection

* Update airbyte-webapp/src/components/CreateConnectionContent/CreateConnectionContent.tsx

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* Fixes broken links so we can deploy again (#14075)

also adds better error message for when this happens to others

* Adds symmary.md to gitignore (#14078)

* Added webflow icon (#14069)

* Added webflow icon

* Added icon

* Build create connection form build failure (#14081)

* Fix CDK obfuscation of nested secrets (#14035)

* Added Buy Credits section to Managing Airbyte Cloud (#13905)

* Added Buy Credits section to Managing Airbyte Cloud

* Made some style changes

* Made edits based on Natalie's suggestions

* Deleted link

* Deleted line

* Edited email address

* Updated reaching out to sales sentence

* disable es-lit to fix build (#14087)

* Release source connectors (#14077)

* Release source connectors

* Fix issue with database connection in test

* Fix failing tests due to authentication

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Bump Airbyte version from 0.39.23-alpha to 0.39.24-alpha (#14094)

Co-authored-by: jdpgrailsdev <jdpgrailsdev@users.noreply.github.com>

* Emit the state to remove in the airbyte empty source (#13725)

What
This PR updates the EmptyAirbyteSource in order to perform a partial update and handle the new state message format.

How
The empty will now emit different messages based on the type of state being provided:

Per stream: it will emit one message per stream that have been reset
Global: It will emit one global message that will contain null for the stream that have been reset including the shared state
Co-authored-by: Jimmy Ma <jimmy@airbyte.io>

* Add StatePersistence object (#13900)

Add a StatePersistence object that supports Read/Writes of States to the DB with StreamDescriptor fields

The only migrations that is supported are
* moving from LEGACY to GLOBAL
* moving from LEGACY to STREAM
* All other state type migrations are expected to go through an explicit reset beforehand.

* secret-persistence: Hashicorp Vault Secret Store (#13616)

Co-authored-by: Amanda Murphy <amanda.murphy@heapanalytics.com>
Co-authored-by: Benoit Moriceau <benoit@airbyte.io>

* 🐛 Source Hubspot: remove `AirbyteSentry` dependency (#14102)

* fixed

* updated changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* fix: format VaultSecretPersistenceTest.java (#14110)

* Source Hubspot: extend error logging (#14054)

* #291 incall - source Hubspot: extend error logging

* huspot: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Update webflow.md (#14083)

* Update webflow.md

Removed a description that is only applicable to people that are writing connector code, not to _users_ of the connector.

* Update webflow.md

* Update webflow.md

* Update webflow.md

* Update webflow.md

* 12708: Add an option to use encryption with staging in Redshift Desti… (#14013)

* 12708: Add an option to use encryption with staging in Redshift Destination (#13675)

* 12708: Add an option to use encryption with staging in Redshift Destination

* 12708: docs/docker configs updated

* 12708: merge with master

* 12708: merge fix

* 12708: code review implementation

* 12708: fix for older configs

* 12708: fix for older configs in check

* 12708: merge from master (consolidation issue)

* 12708: versions updated

* 12708: specs updated

* 12708: specs updated

* 12708: removing autogenerated files from PR

* 12708: changelog updated

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Source PayPal Transaction: Update Transaction Schema (#13682)

* Update transaction schema.
* Transform money values from strings to floats or integers.

Co-authored-by: nataly <nataly@airbyte.io>
Co-authored-by: Augustin <augustin.lafanechere@gmail.com>

* fix(jsonSchemas): raise error when items property not provided (#14018)

* fix stream name in stream transformation update (#14044)

* 🐛 Destination Redshift: Improved discovery for redshift-destination not SUPER streams (#13690)

airbyte-12843: Improved discovery for redshift-destination not SUPER tables, excluded views from discovery.

* Remove skiptests option (#14100)

* update sentry release script (#14123)

* Remove "additionalProperties": false from specs for connectors with staging (#14114)

* Remove "additionalProperties": false from spec for connectors with staging

* Remove "additionalProperties": false from spec for Redshift destination

* bump versions

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* [14003] source-oracle: added custom jdbc field (#14092)

* [14003] source-oracle: added custom jdbc field

* Add JobErrorReporter for sending sync job connector failures to Sentry (#13899)

* skeleton for reporting connector errors to sentry

* report on job failures instead of attempt failures

* report sync job failures with relevant metadata using JobErrorReporter

* send stack traces from python connectors to sentry

* test JobCreationAndStatusUpdate and JobErrorReporter

* logs

* refactor into helper, initial tests

* using sentry

* run format

* load reporting client from env

* load sentry dsn from env

* send java stack traces to sentry

* test sentryclient, refactor to use Hub instance

* ErrorReportingClient.report -> .reportJobFailureReason

* inject exception helper, test stack trace parse error tagging

* rm logs

* more stack trace tests

* remove logs

* fix failing tests

* rename ErrorReportingClient to JobErrorReportingClient

* rename vars in docker-compose

* Return an Optional instead of null when parsing stack traces

* dont remove airbyte prefix when setting release name

* from_trace_message static

* remove failureSummary from jobfailure input, get from Job

* send stacktrace string if we weren't able to parse

* set deployment mode tag

* update .env

* just log if something goes wrong

* Use StateMessageHelper in source (#14125)

* Use StateMessageHelper in source

* PR feedback and formatting

* More PR feedback

* Revert change

* Revert changes

* Bump Airbyte version from 0.39.24-alpha to 0.39.25-alpha (#14124)

Co-authored-by: brianjlai <brianjlai@users.noreply.github.com>

* Refactor acceptance tests and utils (#13950)

* Refactor Basic acceptance tests and utils

* Refactor Advanced acceptance tests and utils

* Remove unused code

* Clear destination db data during cleanup

* Cleanup comments

* cleanup init code

* test creating new desintation db for each test

* cleanup desintation db init

* Allow to edit api client

* pull in temporal cloud changes

* Rename helper to harness; set some funcs to private; turn init into constructor

* add func to set env vars instead of using static vars and move some functionality out of init into acceptance tests

* update javadoc

Co-authored-by: Davin Chia <davinchia@gmail.com>

* fix javadoc formatting

* fix var naming

Co-authored-by: Davin Chia <davinchia@gmail.com>

* Bump Airbyte version from 0.39.25-alpha to 0.39.26-alpha (#14141)

Co-authored-by: terencecho <terencecho@users.noreply.github.com>

* 🎉 octavia-cli: Add ability to get existing resources (#13254)

* 13541 Fixed integration tests source-db2 Mac OS (#14133)

* 13523 Fix integration tests destination-cassandra Mac OS (#14134)

* 🐛 Source Hubspot: fixed SAT test, commented out expected_records (#14140)

* :bug: Source Intercom: extend `Contacts` schema with new properties (#14099)

* Source Twilio: adopt best practices (#14000)

* #1946 Source twilio: aopt best practices - tune tests

* #1946 add expected_records to acceptance-test-config.yml

* #1946 source twilio - upd schema and changelog

* #1946 fix expected_records

* #1946 source twilio: rm alerts from expected records as they expire in 30 days

* #1946 source twilio: bump version

* 🎉 Source BingAds:  expose hourly/daily/weekly/monthly options from configuration (#13801)

* #12489 - expose hourly/daily/weekly/monthly reports in discovery by default instead of in the connector's configuration settings

removed:  config settings for hourly/daily/weekly/monthly reports
added:    default value for all periodic reports to True

* #12489 - expose hourly/daily/weekly/monthly reports in discovery by default instead of in the connector's configuration settings

removed:  unused class variables, if-statement

* #12489 - expose hourly/daily/weekly/monthly reports in discovery by default instead of in the connector's configuration settings

removed:  unused variables from config

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* remove VersionMismatchServer (#14076)

* remove VersionMismatchServer

* remove VersionMismatchServerTest

* revert intended changes

* Increase instance termination time limit to 3 hours to accommodate connector builds. (#14181)

* Use correct bash comment symbol. (#14183)

* 🎉 New Source: Orbit.love (#13390)

* source-orbit: add definition and specs (#14189)

* 🎉 Base Norrmalization: clean-up Redshift `tmp_schemas` after SAT (#14015)

Now after `base-normalization` SAT the Destination Redshift will be automatically cleaned up from test leftovers. Other destinations are not covered yet.

* Source Salesforce: fix customIntegrationTest for SAT (#14172)

* Source Amazon Ads: increase timeout for SAT (#14167)

* 🎉  Introduce Google Analytics Data API source (#12701)

* Introduce Google Analytics Data API source

https://developers.google.com/analytics/devguides/reporting/data/v1

* Add Google Analytics Data API source PR link

* Add `client` class for Google Analytics Data API

* Move dimensions and metrics extraction to the `client` class

In the Google Analytics Data API

* Change the copyright date to 2022 in Google Analytics Data API

* fix: removing incremental syncs

* fix: change project_id to string

* fix: flake check is failing

* chore: added it to source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>

* 🐛 Destination Redshift: use s3 bucket path for s3 staging operations (#13916)

* Publish acceptance test utils maven artifact (#14142)

* Fix StatePersistence Legacy read/write (#14129)

StatePersistence will wrap/unwrap legacy state on write/read to ensure
compatibility with the old behavior/data.

* 🎉 Destination connectors: Improved "SecondSync" checks in Standard Destination Acceptance tests (#14184)

* [11731] Improved "SecondSync" checks in Standard Destination Acceptance tests

* 🐛 Source Zendesk Support: fixed "Retry-After" non integer value (#14112)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Source Tiktok Marketing: Videometrics (#13650)

* added video metrics in streams.py

* common metrics list updated.

* updated streams.py with extended metrics required.

* updated stream_test

* updated configured_catalog

* video metrics required list updated.

* chore: formatting

* chore: bump version in source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>

* 🎉 Source Github: secondary rate limits has to retry (#13955)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Harshith/test pr 13118 (#14192)

* Firebolt destination

* feat: Write method dropdown

* feat: Use future-proof Auth in SDK

* refactor: Move writer instantiation

* fix: tests are failing

* fix: tests are failing

* fix: tests are failing

* chore: added connector to definitions

* fix: formatting and spec

* fix: formatting for orbit

Co-authored-by: ptiurin <petro.tiurin@firebolt.io>

* 🪟 :art: Show credit usage on chart's specific day (#13503)

* add tooltip to chart

* Fixes:
- update main chart color;
- change onHover background color

* change chart color pallet to grey 500

* update color reference

* remove opacity from UsageCell

* 🐛 destination-redshift: use s3 bucket path for s3 cleanup (#14190)

* Improve documentation for Postgres Source (#13830)

* Improve documentation for Postgres Source
 * add information about additional JDBC params
 * add anchors for doc sections
 * fix link to CDC on Bare Metal
 * add more details about parsing date/time values
 * add doc link to SSH fields

* Handle null reset source config (#14202)

* handle null reset source config

* format

* Wait indefinitely if connection is not active (#14200)

* also wait indefinitely if connection is deleted

* fix test

* Bump Airbyte version from 0.39.26-alpha to 0.39.27-alpha (#14204)

Co-authored-by: lmossman <lmossman@users.noreply.github.com>

* Bmoric/feature flag for state deserialization (#14127)

* Add Feature flag

* Add default feature flag value

* Update test

* remove unsused

* tmp

* Update tests

* rm unwanted change

* PR comments

* [low-code connectors] default types and default values (#14004)

* default types and default values

* cleanup

* fixes so read works

* remove prints and trycatch

* comment

* remove unused param

* split file

* extract method

* extract methods

* comment

* optional

* fix test

* cleanup

* delete interpolated request header provider

* simplify next page url paginator interface

* comment

* format

* add state type endpoint (#14111)

* Bump Airbyte version from 0.39.27-alpha to 0.39.28-alpha (#14210)

Co-authored-by: sherifnada <sherifnada@users.noreply.github.com>

* 🐛 source-orbit: remove workspace_old.json (#14208)

* Fix: Docs plural login redirecting to wrong URL (#14207)

* [docs] fix numbering and incorrect filename in CDK docs (#13045)

* [docs] fix numbering in CDK docs

* Update 5-declare-schema.md

* Update 5-declare-schema.md

* Update 6-read-data.md

* Update 8-test-your-connector.md

* Remove the old scheduler from HelmCharts helper (#14187)

* Remove the old scheduler from HelmCharts helper

The old scheduler was removed as part of https://github.com/airbytehq/airbyte/pull/13400

* Remove legacy `scheduler` comment in HelmCharts

* Source Gitlab: add GroupIssueBoards stream (#13252)

* GitLab Source: add GroupIssueBoards stream

* Address stream schema comments

* Address comments

* Bump version

* Add as empty stream

* run seed file source (#14215)

* fix 'cannot reach server' error on demo instance (#10020)

* Update CODEOWNERS (#14209)

* 🎉 Source Github: use GraphQL for `reviews` stream (#13989)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* workflow for publishing artifacts for cloud (#14199)

* fix sentry org slug change (#14218)

* Source File: correct spec json to match json format (#13738)

* Upgrade spotless version and remove jvmargs workaround (#13705)

* Source Zendesk Chat: Process large amount of data in batches for incremental  (#14214)

* increased the limit of itens in request

* Configuration for max api pages on requests

* included api_pagination_limit in sample

* included api_pagination_limit in invalid_config

* creating new table for chat_session

* reverted api_pagination_limit approach

* removed api_pagination_limit from TimeIncrementalStream

* correct chat json

* bump connector version

* add changelog

* run format

* auto-bump connector version

Co-authored-by: Roberto Bonnet <robertojuarezwp@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Remove all @ts-ignore (#14221)

* Bump hadoop to use version 3.3.3 (#14182)

* Change the persistence activity to use the new persistence layer (#14205)

* Change the persistence activity to use the new persistence layer

* Use lombok

* format

* Use new State message helper

* Fix build (#14225)

* Fix build

* Fix test

* Use new state persistence for state reads (#14126)

* Inject StatePersistence into DefaultJobCreator
* Read the state from StatePersistence instead of ConfigRepository
* Add a conversion helper to convert StateWrapper to State
* Remove unused ConfigRepository.getConnectionState

* Temporal per stream resets (#13990)

* remove reset flags from workflow state + refactor

* bring back cancelledForReset, since we need to distinguish between that case and a normal cancel

* delete reset job streams on cancel or success

* extract isResetJob to method

* merge with master

* set sync modes on streams in reset job correctly

* format

* Add test for getAllStreamsForConnection

* fix tests

* update more tests

* add StreamResetActivityTests

* fix tests for default job creator

* remove outdated comment

* remove debug lines

* remove unused enum value

* fix tests

* fix constant equals ordering

* make job mock not static

* DRY and add comments

* add comment about deleted streams

* Remove io.airbyte.config.StreamDescriptor

* regisster stream reset activity impl

* refetch connection workflow when checking job id, since it may have been restarted

* only cancel if workflow is running, to allow reset signal to always succeed even if batched with a workflow start

* fix reset signal to use new doneWaiting workflow state prop

* try to fix tests

* fix reset cancel case

* add acceptance test for resetting while sync is running

* format

* fix new acceptance test

* lower sleep on test

* raise sleep

* increase sleep and timeout, and remove repeated test

* use CatalogHelpers to extract stream descriptors

* raise sleep and timeout to prevent transient failures

* format

Co-authored-by: alovew <anne@airbyte.io>

* Log Marketo response errors

* Additional message if Marketo response has failed with empty errors

Co-authored-by: Topher Lubaway <asimplechris@gmail.com>
Co-authored-by: Malik Diarra <malik@airbyte.io>
Co-authored-by: Teal Larson <LARSON.TEAL@GMAIL.COM>
Co-authored-by: Tim Roes <tim@airbyte.io>
Co-authored-by: Benoit Moriceau <benoit@airbyte.io>
Co-authored-by: Lake Mossman <lake@airbyte.io>
Co-authored-by: VitaliiMaltsev <39538064+VitaliiMaltsev@users.noreply.github.com>
Co-authored-by: grishick <greg@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Greg Solovyev <grishick@users.noreply.github.com>
Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: Andy <andy@airbyte.io>
Co-authored-by: LiRen Tu <tuliren.git@outlook.com>
Co-authored-by: oneshcheret <33333155+sashaNeshcheret@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Xiaohan Song <xiaohan@airbyte.io>
Co-authored-by: Augustin <augustin.lafanechere@gmail.com>
Co-authored-by: Octavia Squidington III <90398440+octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
Co-authored-by: Charles <charles@airbyte.io>
Co-authored-by: Jimmy Ma <gosusnp@users.noreply.github.com>
Co-authored-by: Sophia Wiley <106352739+sophia-wiley@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Denis Davydov <davydov.den18@gmail.com>
Co-authored-by: Subodh Kant Chaturvedi <subodh1810@gmail.com>
Co-authored-by: Bastien Gandouet <bastien@mozaiqu.es>
Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
Co-authored-by: Paweł Kociński <pawel93kocinski@gmail.com>
Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Baz <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>
Co-authored-by: Amruta Ranade <11484018+Amruta-Ranade@users.noreply.github.com>
Co-authored-by: Alexander Marquardt <alexander.marquardt@gmail.com>
Co-authored-by: edgao <edgao@users.noreply.github.com>
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
Co-authored-by: George Claireaux <george@claireaux.co.uk>
Co-authored-by: mutt-santiago-stachuk <106173005+mutt-santiago-stachuk@users.noreply.github.com>
Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Arsen Losenko <20901439+arsenlosenko@users.noreply.github.com>
Co-authored-by: Petro Tiurin <93913847+ptiurin@users.noreply.github.com>
Co-authored-by: ptiurin <petro.tiurin@firebolt.io>
Co-authored-by: Andrii Leonets <30464745+DoNotPanicUA@users.noreply.github.com>
Co-authored-by: Jonathan Pearlin <jonathan@airbyte.io>
Co-authored-by: Jimmy Ma <jimmy@airbyte.io>
Co-authored-by: Ganpat Agarwal <gagarwal@artica.com>
Co-authored-by: Rajakavitha Kodhandapani <krajakavitha@gmail.com>
Co-authored-by: Yevhen Sukhomud <suhomud@gmail.com>
Co-authored-by: sw-yx <shawnthe1@gmail.com>
Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>
Co-authored-by: Eugene <etsybaev@gmail.com>
Co-authored-by: Anna Lvova <37615075+annalvova05@users.noreply.github.com>
Co-authored-by: Vladimir <volodymyr.s.petrov@globallogic.com>
Co-authored-by: Phlair <Phlair@users.noreply.github.com>
Co-authored-by: Parker Mossman <parker@airbyte.io>
Co-authored-by: Adam <adam-bloom@users.noreply.github.com>
Co-authored-by: Liren Tu <tuliren@gmail.com>
Co-authored-by: pmossman <pmossman@users.noreply.github.com>
Co-authored-by: Brian Lai <51336873+brianjlai@users.noreply.github.com>
Co-authored-by: Peter Hu <peter@airbyte.io>
Co-authored-by: Tuhai Maksym <kimerinn@gmail.com>
Co-authored-by: sajarin <sajarindider@gmail.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: steve withington <steve@digitalmine.com>
Co-authored-by: Leo Sussan <leosussan@gmail.com>
Co-authored-by: cenegd <cenegd@live.com>
Co-authored-by: Tomas Perez Alvarez <72174660+Tomperez98@users.noreply.github.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Co-authored-by: Yurii Bidiuk <yura.bidyuk@gmail.com>
Co-authored-by: Christophe Duong <christophe.duong@gmail.com>
Co-authored-by: jdpgrailsdev <jdpgrailsdev@users.noreply.github.com>
Co-authored-by: Stella Chung <schung507@gmail.com>
Co-authored-by: Amanda Murphy <amanda.murphy@heapanalytics.com>
Co-authored-by: Mohamed Magdy <mohamed.magdy@canary.is>
Co-authored-by: nataly <nataly@airbyte.io>
Co-authored-by: Tyler Russell <tylerrussell85@gmail.com>
Co-authored-by: Alexander Tsukanov <alexander.tsukanovvv@gmail.com>
Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
Co-authored-by: brianjlai <brianjlai@users.noreply.github.com>
Co-authored-by: terencecho <terence@airbyte.io>
Co-authored-by: terencecho <terencecho@users.noreply.github.com>
Co-authored-by: Daniel Diamond <33811744+danieldiamond@users.noreply.github.com>
Co-authored-by: drrest <dr.rest@gmail.com>
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
Co-authored-by: Zawar Khan <zawar.khan@getmercury.io>
Co-authored-by: sherifnada <sherifnada@users.noreply.github.com>
Co-authored-by: Sachin Jangid <sachinjangid832@gmail.com>
Co-authored-by: Chris Wu <chris@faros.ai>
Co-authored-by: Jared Rhizor <me@jaredrhizor.com>
Co-authored-by: tison <wander4096@gmail.com>
Co-authored-by: Roberto Bonnet <robertojuarezwp@gmail.com>
Co-authored-by: alovew <anne@airbyte.io>
shrodingers added a commit to Brigad/airbyte that referenced this pull request Jul 6, 2022
@shrodingers @alafanechere
@edmundito @evantahler @timroes @cgardens @jdpgrailsdev @Amruta-Ranade @benmoriceau @gosusnp @ganpatagarwal @grubberr @Rajakavitha1 @suhomud @DoNotPanicUA @Phlair @VitaliiMaltsev @octavia-squidington-iii @swyxio @bazarnov @etsybaev @davydov-d @annalvova05 @dizel852 @pmossman @adam-bloom @tuliren @supertopher @brianjlai @git-phu @subodh1810 @kimerinn @alexander-marquardt @sajarin @marcosmarxm @girarda @stevewithington @leosussan @ss098 @Tomperez98 @lmossman @sherifnada @edgao @yurii-bidiuk @ChristopheDuong @teallarson @sophia-wiley @schung507 @mohamagdy @terussell85 @alexandertsukanov @pedroslopez @terencecho @davinchia @danieldiamond @drrest @avaidyanatha @harshithmullapudi @Zawar92 @ptiurin @grishick @gittysachin @cjwooo @jrhizor @tisonkun @RobertoBonnet @malikdiarra @alovew @alexandr-shegeda @midavadim @arsenlosenko @xorl @remlabm @sspaeti @cstruct @calebfornari @ct-martin @jordan-glitch @Daemonxiao @keiththompson @jonico
Shrodingers/destination databricks dbt (#1)
bb8f79e 
* octavia-cli: fix workspace not having anonymous_data_collection property (#13869)

* Update connection update calls to use central utility to ensure connection update has all data (#13564)

* Update connection updates with build update utility
* Add buildConnectionUpdate utility
* Update components that update the connection to use utility when necessary

* Use conection name when saving connection from replication view to prevent override from refreshed catalog

* Improve connection check on ReplicationView onSubmit function

* Display connection state in connection setting page (#13394)

* Display Connection State in Setting page

* memoize callback

* rendering and confirmaton

* setState API

* Input validation

* remove JSON step

* rename apiMethod to `updateState`

* test and adjust route

* skip if sync is running

* prevent state update when sync is running

* code editor component

* errors fixed

* scss style

* make linter happy

* Back to monaco editor

* Remove ability to edit state

* Adjust FE code

* Fix CSS problem

* Update airbyte-webapp/src/locales/en.json

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* just use PRE to render state for now

Co-authored-by: Tim Roes <tim@airbyte.io>
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* update api for per stream (#13835)

* Update airbyte-protocol.md (#13892)

* Update airbyte-protocol.md

* Fix typo

* Fix prose

* Add protocol reviewers for protocol documentation

* Remove duplicate

* Edited Amplitude, Mailchimp, and Zendesk Support docs (#13897)

* deleting SUMMARY.md since we don't need it for docusaurus builds (#13901)

* Do not hide unexpected errors in the check connection (#13903)

* Do not hide unexpected errors in the check connection

* Fix test

* Common code to deserialize a state message in the new format (#13772)

* Common code to deserialize a state message in the new format

* PR comments and type changed to typed

* Format

* Add StateType and StateWrapper objects to the model

* Use state wrapper instead of Either

* Switch to optional

* PR comments

* Support array legacy state

* format

Co-authored-by: Jimmy Ma <jimmy@airbyte.io>

* 🐛 Source Amazon Seller Partner: handle start date for financial stream (#13633)

* start and end date for finacial stream should not be more than 180 days apart

* improve unit tests

* make changes to start date for finance stream

* update tests

* lint changes

* update version to 0.2.22 for source-amazon-seller-partner

* Normalization: Fix incorrect jinja2 macro `json_extract_array` call (#13894)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Docs: fixed the broken links (#13915)

* 0.2.5 -> 0.2.6 (#13924)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* 13546 Fix integration tests source-postgres Mac OS (#13872)

* 13546 Fix integration tests source-postgres Mac OS

* 13548 Fixed integration tests source-tidb Mac OS (#13927)

* Source MsSql : incr ver to include changes #13854 (#13887)

* incr version

* put PR id

* docker ver

* connectors that published (#13932)

* Deprecate PART_SIZE_MB in connectors using S3/GCS storage (#13753)

* Removed part_size from connectors that use StreamTransferManager

* fixed S3DestinationConfigTest

* fixed S3JsonlFormatConfigTest

* upadate changelog and bump version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* upadate changelog and bump version for Redshift and Snowflake destinations

* auto-bump connector version

* fix GCS staging test

* fix GCS staging test

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Reverted changes in SshBastionContainer (#13934)

* 🎉 New Source Dockerhub (#13931)

* init

* implement working source + tests

* add docs

* add docs

* fix bad comments

* Update airbyte-integrations/connectors/source-dockerhub/acceptance-test-config.yml

* Update airbyte-integrations/connectors/source-dockerhub/Dockerfile

* Update airbyte-integrations/connectors/source-dockerhub/.dockerignore

* Apply suggestions from code review

* Update docs/integrations/sources/dockerhub.md

* Update airbyte-integrations/connectors/source-dockerhub/integration_tests/acceptance.py

Co-authored-by: George Claireaux <george@airbyte.io>

* address @Phlair's feedback

* address @Phlair's feedback

* each record is now a Docker image rather than response page

* format

* fix unit tests

* fix acceptance tests

* add icon, definition and generate seed spec

* add requests to requirements

Co-authored-by: sw-yx <shawnthe1@gmail.com>

* commented out non-relevant tests (#13940)

* Bump Airbyte version from 0.39.20-alpha to 0.39.21-alpha (#13938)

Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>

* newaction (#13942)

* remove test action (#13944)

* 🎉Source-mysql: aligned datatype test (#13945)

* [13607] source-mysql: aligned datatype tests for regular and CDC ways + added CHAR fix to CDC processing

* #13958 Source Stripe: fix configured catalogs (#13959)

* 🐛 Source: Typeform - Update schema for Responses stream (#13935)

* Upd responses schema

* Upd docs

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* :window: Updated email invitation flow that enables invited users to set name and create password (#12788)

* First pass accepting email link invitation
* Update Auth service with signInWithEmailLink calls
* Add AcceptEmailInvite component
* Update FirebaseActionRoute to handle sign in mode
* Rename ResetPasswordAction to FirebseActionRoute

* Add create password setp to AcceptEmailInvite component

* Remove continueURL from invite fetch

* Update accept email invite for user to enter both email and password together

* Set name during email link signup

* Update AcceptEmailInvite to send name
* Add updateName to UserService
* Update AuthService to set name during sign up

* Remove steps from AcceptEmailInvite component
Remove setPassword from AuthService

* Add header and title to accept invite page

* Move invite error messages to en file

* For invite link pages, show login link instead of sign up

* Disable name update on sign in via email lnk

* Resend email invite when the invite link is expired

* Fix status message in accept email invite page

* Re-enable set user's name during sign up email invite

* Update signUpWithEmailLink so that sign up is successful even if we fail to update the user's name

* Update comments on GoogleAuthService signInWithEmailLink

* Add newsletter and accept terms checkboxes to accept email invite component
* Extract signup form from signup page
* Extract fields from signup form
* Update accept email invite component to use field components from signup form
* Ensure that sign up button is disable until form is valid and security checkbox is checked

* Make error status text color in accept email link red

* Update workspace check in DefaultView so that user lands in workspace selector when there are no workspaces

* Add coment around continueUrl param usage in UserService

* Remove usless default case in GoogleAuthService

* Source Marketo: process fail during creation of an export job (#13930)

* #9322 source Marketo: process fail during creation of an export job

* #9322 source marketo: upd changelog

* #9322 source marketo: fix unit test

* #9322 source marketo: fix SATs

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* :window: :wrench: Add eslint rules for CSS modules (#13952)

* add eslint-plugin-css-modules rules

* Fixes:
- turn on eslint css modules rule as error
- remove unused styles

* add warning message if styled components is used

* Revert "add warning message if styled components is used"

This reverts commit 4e92b8b2110142bb679f15aeb034e377e0dcc69c.

* replace rule severity with words

* Update salesforce.md

Fixed broken link

* :window: 🔧 Add auto-fixable linting rules to webapp (#13462)

* Add new eslint rules that fit with our code style and downgrade rules to warn

* allowExpressions in fragment eslint rule

* Enable function-component-definition in eslint and fix styles

* Cleanup lint file

* Fix react/function-component-definition warnings manually

* Add more auto-fixable rules and fix

* Fix functions that require usless returns

* Update array-type rule to array-simple

* Fix eslint errors manually
disable assignmentExpression for arrays in prefer-destructuring rule

* Auto fix new linting issues after rebase

* Enhance /publish to allow for multiple connectors and parallel execution (#13864)

* start

* revert

* azblob

* bq

* bq denorm

* megapublish baaaabyyyy

* fix needs

* matrix connectors

* auto-bump connector version

* dont failfast and max parallel 5

* multi runno

* minor

* testing matrix agents

* name

* testing multi agents

* tmp fix

* new multi agents

* multi test

* tryy

* let's do this

* magico

* fix

* label test

* couple more connector bumps

* temp

* things

* check this

* lets gooo

* more connectors

* Delete TEMP-testing-command.yml

* auto-bump connector version

* added comment describing bash part

* running single thread

* catch sentry cli

* auto-bump connector version

* destinations

* + snowflake

* saved

* auto-bump connector version

* auto-bump connector version

* java source bumps

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* remove twice-defined methods

* label things

* revert action

* using the new test action

* point at action

* wrong tag on action

* update pool label

* update to use new ec2-github-runner fork

* this needs to be more generic than publisher

* change publish to run on pool

* add comment about runner-pool usage

* updated publish command docs for multi & parallel connector runs

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* unbump failed publish versions

* missed dockerfiles

* remove failed docs

* mssql fix

* overhauled the git comment output

* bumping a test connector that should work

* slight order switcheroo

* output connectors properly in first message

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Bump Airbyte version from 0.39.21-alpha to 0.39.22-alpha (#13979)

Co-authored-by: Phlair <Phlair@users.noreply.github.com>

* Parker/temporal cloud (#13243)

* switch to temporal cloud client for now

* format

* use client cert/key env secret instead of path to secret

* add TODO comments

* format

* add logging to debug timeout issue

* add more logging

* change workflow task timeout

* PR feedback: consolidate as much as possible, add missing javadoc

* fix acceptance test, needs to specify localhost

* add internal-use only comments

* format

* refactor to clean up TemporalClient and prepare it for future dependency injection framework

* remove extraneous log statements

* PR feedback

* fix test

* return isInitialized true in test

* 📄  Postgres source: fix CDC setup order in docs (#13949)

* postgres source: fix CDC setup order docs

* Update docs/integrations/sources/postgres.md

Co-authored-by: Liren Tu <tuliren@gmail.com>

* Per-stream state support for Postgres source (#13609)

* WIP Per-stream state support for Postgres source

* Fix failing test

* Improve code coverage

* Make global the default state manager

* Add legacy adapter state manager

* Formatting

* Include legacy state for backwards compatibility

* Add global state manager

* Implement Global/CDC state handling

* Fix test issues

* Fix issue with updated method signature

* Handle empty state case in global state manager

* Adjust to protocol changes

* Fix failing acceptance tests

* Fix failing test

* Fix unmodifiable list issue

* Fix unmodifiable exception

* PR feedback

* Abstract global state manager selection

* Handle conversion between different state types

* Handle invalid conversion

* Rename parameter

* Refactor state manager creation

* Fix failing tests

* Fix failing integration tests

* Add CDC test

* Fix failing integration test

* Revert change

* Fix failing integration test

* Use per-stream for postgres tests

* Formatting

* Correct stream descriptor validation

* Correct permalink

* PR feedback

* Bump Airbyte version from 0.39.22-alpha to 0.39.23-alpha (#13984)

Co-authored-by: pmossman <pmossman@users.noreply.github.com>

* Adds test for new workflow (#13986)

* Adds test for new workflow

* Adds airbyte repo

* remove testing line

* Add new InterpolatedRequestOptionsProvider that encapsulates all variations of request arguments (#13472)

* write out new request options provider and refactor components and parts of the YAML config

* fix formatting

* pr feedback to consolidate body_data_provider to simplify the code

* pr feedback get rid of extraneous optional

* publish oss for cloud (#13978)

workflow to publish oss artifacts that cloud needs to build against
use docker buildx to create arm images for local development

* skip debezium engine startup in case no table is in INCREMENTAL mode (#13870)

* 🎉 Source Github: break point added for workflows_runs stream (#13926)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* 6339: error when attempting to use azure sql database within an elastic pool as source for cdc based replication (#13866)

* 6339: debug info

* 6339: not using 'USE' on Azure SQL servers

* 6339: cleanup

* 6339: cleanup2

* 6339: cleanup3

* 6339: versions/changelogs updated

* 6339: merge from master (consolidation issue)

* 6339: dev connector version (for testing in airbyte cloud)

* 6339: code review implementation

* 6339: apply formatting

* in case runners fail to spin up, this needs to run on github-hosted (#13996)

* 12708: Add an option to use encryption with staging in Redshift Destination (#13675)

* 12708: Add an option to use encryption with staging in Redshift Destination

* 12708: docs/docker configs updated

* 12708: merge with master

* 12708: merge fix

* 12708: code review implementation

* 12708: fix for older configs

* 12708: fix for older configs in check

* 12708: merge from master (consolidation issue)

* 12708: versions updated

* :tada: New Source: Webflow (#13617)

* Added webflow code

* Updated readme

* Updated README

* Added webflow to source_definitions.yaml

* Enhanced documentation for the Webflow source connector

* Improved webflow source connector instructions

* Moved Site ID to before API token in Spec.yaml (for presentation in the UI)

* Addressed comments in PR.

* Changes to address requests in PR review

* Removed version from config

* Minor udpate to spec.yaml for clarity

* Updated to pass the accept-version as a constant rather than parameter

* Updated check_connection to hit the collections API that requires both site id and the authentication token.

* Fixed the test_check_connection to use the new check_connection function

* Added a streams test for generate_streams

* Re-named "autentication" object to "auth" to be more consistent with the way it is created by the CDK

* Added in an explict line to instantiante an "auth" object from WebflowTokenAuthenticator, to make it easier to describe in the blog

* Fixed a typo in a comment

* Renamed some classes to be more intuitive

* Renamed class to be more intuitive

* Minor change to an internal method name

* Made _get_collection_name_to_id_dict staticmethod

* Fixed a unit-test error that only appeared when running " python -m pytest -s unit_tests".
This was caused by Mocked settings from test_source.py leaking into test_streams.py

* format: add double quotes and remove unused import

* readme: remove semantic version naming of connector in build commands

* Updated spec.yaml

* auto-bump connector version

* format files

* add changelog

* update dockerfile

* auto-bump connector version

Co-authored-by: sajarin <sajarindider@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>

* Source-oracle: fixed tests + checkstyle (#13997)

* Source-oracle: fixed tests + checkstyle

* 🐛Destination-mysql: fixed integration test and build process (#13302)

* [13180] destination-mysql: fixed integration test

* update changelog to include debezium version upgrade (#13844)

* make table headers look less like successes (#13999)

* source-twilio: implement lookback windows (#13896)

* Revert "12708: Add an option to use encryption with staging in Redshift Destination (#13675)" (#14010)

This reverts commit aa28d448d820df9d79c2c0d06b38978d1108fb2c.

* Revert "6339: error when attempting to use azure sql database within an elastic pool as source for cdc based replication (#13866)" (#14011)

This reverts commit 0d870bd37bc3b5cd798b92115d73bcc45a42d8f7.

* [low-code connectors] BasicHttpAuthenticator (#13733)

* implement basichttpauthenticator

* add optional refresh access token authenticator

* remove prints

* type hints

* Fix and unit test

* missing test

* Add class to __init__ file

* Add comment

* migrate JsonSchemas to use basic path instead of JSONPath (#13917)

* scaffold for catalog diff, needs fixing on type handling and tests (#13786)

* Prepare release of JDBC connectors (#13987)

* Prepare release of JDBC connectors

* Update source definitions manually

* use built in check for if path is definite (#13834)

* 13535 Fixed bastion network for integration tests (#14007)

* doc: add error troubleshooting `docker-compose up` (#13765)

* fix: duplicate resource allocations in `airbyte-temporal` deployment (#13816)

* helm-chart: Fix worker deployment format error (#13839)

* add catalog diff connection read (#13918)

* doc: fix small typo on Shopify documentation (#13992)

* add streams to reset to job info (#13919)

* Generate api for changes in #13370 and make code compatible (#14014)

* Generate api for per-stream updates #13835 (#14021)

* Revert "Prepare release of JDBC connectors (#13987)" (#14029)

This reverts commit df759b30778082508e2872513800fac34d98ff7c.

* Fix per stream state protocol backward compatibility (#14032)

* rename state type field to fix backwards compatibility issue

* replace usages of stateType with type

* support semi incremental by adding extractor record filter (#13520)

* support semi incremental by adding extractor record filter

* refactor extractor into a record_selector that supports extraction and filtering of response records

* Remove pydantic spec from amazon ads and use YAML spec (#13988)

* add EdDSA support in SSH tunnel (#9494)

* add EdDSA support

* verify EdDSA support works correct

Co-authored-by: Yurii Bidiuk <yura.bidyuk@gmail.com>

* 🎉New source connector: source-metabase (#13752)

* Add docs

* Close metabase session when sync finishes

* Close session in check_connection

* Add source definition to seed

* Add icon

* improve cdc check for connectors (#14005)

* improve should use cdc check

* Revert "improve should use cdc check"

This reverts commit 7d01727279d21d33a6c18ed3227ee94432636120.

* improve should use cdc check

* add unit test

* Update webflow.md

* Update webflow.md

* Update webflow.md

* Remove legacy sentry code from cdk (#14016)

* rip sentry out of cdk

* remove sentry dsn from gsc

* Update webflow.md

* Update webflow.md

* Fixed broken links (#14071)

* 🪟Persist unsaved changes on schema refresh (#13895)

* add form values tracker context

* add clarifying comment

* add same functionality to create connection

* Update airbyte-webapp/src/components/CreateConnectionContent/CreateConnectionContent.tsx

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* Fixes broken links so we can deploy again (#14075)

also adds better error message for when this happens to others

* Adds symmary.md to gitignore (#14078)

* Added webflow icon (#14069)

* Added webflow icon

* Added icon

* Build create connection form build failure (#14081)

* Fix CDK obfuscation of nested secrets (#14035)

* Added Buy Credits section to Managing Airbyte Cloud (#13905)

* Added Buy Credits section to Managing Airbyte Cloud

* Made some style changes

* Made edits based on Natalie's suggestions

* Deleted link

* Deleted line

* Edited email address

* Updated reaching out to sales sentence

* disable es-lit to fix build (#14087)

* Release source connectors (#14077)

* Release source connectors

* Fix issue with database connection in test

* Fix failing tests due to authentication

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Bump Airbyte version from 0.39.23-alpha to 0.39.24-alpha (#14094)

Co-authored-by: jdpgrailsdev <jdpgrailsdev@users.noreply.github.com>

* Emit the state to remove in the airbyte empty source (#13725)

What
This PR updates the EmptyAirbyteSource in order to perform a partial update and handle the new state message format.

How
The empty will now emit different messages based on the type of state being provided:

Per stream: it will emit one message per stream that have been reset
Global: It will emit one global message that will contain null for the stream that have been reset including the shared state
Co-authored-by: Jimmy Ma <jimmy@airbyte.io>

* Add StatePersistence object (#13900)

Add a StatePersistence object that supports Read/Writes of States to the DB with StreamDescriptor fields

The only migrations that is supported are
* moving from LEGACY to GLOBAL
* moving from LEGACY to STREAM
* All other state type migrations are expected to go through an explicit reset beforehand.

* secret-persistence: Hashicorp Vault Secret Store (#13616)

Co-authored-by: Amanda Murphy <amanda.murphy@heapanalytics.com>
Co-authored-by: Benoit Moriceau <benoit@airbyte.io>

* 🐛 Source Hubspot: remove `AirbyteSentry` dependency (#14102)

* fixed

* updated changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* fix: format VaultSecretPersistenceTest.java (#14110)

* Source Hubspot: extend error logging (#14054)

* #291 incall - source Hubspot: extend error logging

* huspot: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Update webflow.md (#14083)

* Update webflow.md

Removed a description that is only applicable to people that are writing connector code, not to _users_ of the connector.

* Update webflow.md

* Update webflow.md

* Update webflow.md

* Update webflow.md

* 12708: Add an option to use encryption with staging in Redshift Desti… (#14013)

* 12708: Add an option to use encryption with staging in Redshift Destination (#13675)

* 12708: Add an option to use encryption with staging in Redshift Destination

* 12708: docs/docker configs updated

* 12708: merge with master

* 12708: merge fix

* 12708: code review implementation

* 12708: fix for older configs

* 12708: fix for older configs in check

* 12708: merge from master (consolidation issue)

* 12708: versions updated

* 12708: specs updated

* 12708: specs updated

* 12708: removing autogenerated files from PR

* 12708: changelog updated

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Source PayPal Transaction: Update Transaction Schema (#13682)

* Update transaction schema.
* Transform money values from strings to floats or integers.

Co-authored-by: nataly <nataly@airbyte.io>
Co-authored-by: Augustin <augustin.lafanechere@gmail.com>

* fix(jsonSchemas): raise error when items property not provided (#14018)

* fix stream name in stream transformation update (#14044)

* 🐛 Destination Redshift: Improved discovery for redshift-destination not SUPER streams (#13690)

airbyte-12843: Improved discovery for redshift-destination not SUPER tables, excluded views from discovery.

* Remove skiptests option (#14100)

* update sentry release script (#14123)

* Remove "additionalProperties": false from specs for connectors with staging (#14114)

* Remove "additionalProperties": false from spec for connectors with staging

* Remove "additionalProperties": false from spec for Redshift destination

* bump versions

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* [14003] source-oracle: added custom jdbc field (#14092)

* [14003] source-oracle: added custom jdbc field

* Add JobErrorReporter for sending sync job connector failures to Sentry (#13899)

* skeleton for reporting connector errors to sentry

* report on job failures instead of attempt failures

* report sync job failures with relevant metadata using JobErrorReporter

* send stack traces from python connectors to sentry

* test JobCreationAndStatusUpdate and JobErrorReporter

* logs

* refactor into helper, initial tests

* using sentry

* run format

* load reporting client from env

* load sentry dsn from env

* send java stack traces to sentry

* test sentryclient, refactor to use Hub instance

* ErrorReportingClient.report -> .reportJobFailureReason

* inject exception helper, test stack trace parse error tagging

* rm logs

* more stack trace tests

* remove logs

* fix failing tests

* rename ErrorReportingClient to JobErrorReportingClient

* rename vars in docker-compose

* Return an Optional instead of null when parsing stack traces

* dont remove airbyte prefix when setting release name

* from_trace_message static

* remove failureSummary from jobfailure input, get from Job

* send stacktrace string if we weren't able to parse

* set deployment mode tag

* update .env

* just log if something goes wrong

* Use StateMessageHelper in source (#14125)

* Use StateMessageHelper in source

* PR feedback and formatting

* More PR feedback

* Revert change

* Revert changes

* Bump Airbyte version from 0.39.24-alpha to 0.39.25-alpha (#14124)

Co-authored-by: brianjlai <brianjlai@users.noreply.github.com>

* Refactor acceptance tests and utils (#13950)

* Refactor Basic acceptance tests and utils

* Refactor Advanced acceptance tests and utils

* Remove unused code

* Clear destination db data during cleanup

* Cleanup comments

* cleanup init code

* test creating new desintation db for each test

* cleanup desintation db init

* Allow to edit api client

* pull in temporal cloud changes

* Rename helper to harness; set some funcs to private; turn init into constructor

* add func to set env vars instead of using static vars and move some functionality out of init into acceptance tests

* update javadoc

Co-authored-by: Davin Chia <davinchia@gmail.com>

* fix javadoc formatting

* fix var naming

Co-authored-by: Davin Chia <davinchia@gmail.com>

* Bump Airbyte version from 0.39.25-alpha to 0.39.26-alpha (#14141)

Co-authored-by: terencecho <terencecho@users.noreply.github.com>

* 🎉 octavia-cli: Add ability to get existing resources (#13254)

* 13541 Fixed integration tests source-db2 Mac OS (#14133)

* 13523 Fix integration tests destination-cassandra Mac OS (#14134)

* 🐛 Source Hubspot: fixed SAT test, commented out expected_records (#14140)

* :bug: Source Intercom: extend `Contacts` schema with new properties (#14099)

* Source Twilio: adopt best practices (#14000)

* #1946 Source twilio: aopt best practices - tune tests

* #1946 add expected_records to acceptance-test-config.yml

* #1946 source twilio - upd schema and changelog

* #1946 fix expected_records

* #1946 source twilio: rm alerts from expected records as they expire in 30 days

* #1946 source twilio: bump version

* 🎉 Source BingAds:  expose hourly/daily/weekly/monthly options from configuration (#13801)

* #12489 - expose hourly/daily/weekly/monthly reports in discovery by default instead of in the connector's configuration settings

removed:  config settings for hourly/daily/weekly/monthly reports
added:    default value for all periodic reports to True

* #12489 - expose hourly/daily/weekly/monthly reports in discovery by default instead of in the connector's configuration settings

removed:  unused class variables, if-statement

* #12489 - expose hourly/daily/weekly/monthly reports in discovery by default instead of in the connector's configuration settings

removed:  unused variables from config

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* remove VersionMismatchServer (#14076)

* remove VersionMismatchServer

* remove VersionMismatchServerTest

* revert intended changes

* Increase instance termination time limit to 3 hours to accommodate connector builds. (#14181)

* Use correct bash comment symbol. (#14183)

* 🎉 New Source: Orbit.love (#13390)

* source-orbit: add definition and specs (#14189)

* 🎉 Base Norrmalization: clean-up Redshift `tmp_schemas` after SAT (#14015)

Now after `base-normalization` SAT the Destination Redshift will be automatically cleaned up from test leftovers. Other destinations are not covered yet.

* Source Salesforce: fix customIntegrationTest for SAT (#14172)

* Source Amazon Ads: increase timeout for SAT (#14167)

* 🎉  Introduce Google Analytics Data API source (#12701)

* Introduce Google Analytics Data API source

https://developers.google.com/analytics/devguides/reporting/data/v1

* Add Google Analytics Data API source PR link

* Add `client` class for Google Analytics Data API

* Move dimensions and metrics extraction to the `client` class

In the Google Analytics Data API

* Change the copyright date to 2022 in Google Analytics Data API

* fix: removing incremental syncs

* fix: change project_id to string

* fix: flake check is failing

* chore: added it to source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>

* 🐛 Destination Redshift: use s3 bucket path for s3 staging operations (#13916)

* Publish acceptance test utils maven artifact (#14142)

* Fix StatePersistence Legacy read/write (#14129)

StatePersistence will wrap/unwrap legacy state on write/read to ensure
compatibility with the old behavior/data.

* 🎉 Destination connectors: Improved "SecondSync" checks in Standard Destination Acceptance tests (#14184)

* [11731] Improved "SecondSync" checks in Standard Destination Acceptance tests

* 🐛 Source Zendesk Support: fixed "Retry-After" non integer value (#14112)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Source Tiktok Marketing: Videometrics (#13650)

* added video metrics in streams.py

* common metrics list updated.

* updated streams.py with extended metrics required.

* updated stream_test

* updated configured_catalog

* video metrics required list updated.

* chore: formatting

* chore: bump version in source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>

* 🎉 Source Github: secondary rate limits has to retry (#13955)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Harshith/test pr 13118 (#14192)

* Firebolt destination

* feat: Write method dropdown

* feat: Use future-proof Auth in SDK

* refactor: Move writer instantiation

* fix: tests are failing

* fix: tests are failing

* fix: tests are failing

* chore: added connector to definitions

* fix: formatting and spec

* fix: formatting for orbit

Co-authored-by: ptiurin <petro.tiurin@firebolt.io>

* 🪟 :art: Show credit usage on chart's specific day (#13503)

* add tooltip to chart

* Fixes:
- update main chart color;
- change onHover background color

* change chart color pallet to grey 500

* update color reference

* remove opacity from UsageCell

* 🐛 destination-redshift: use s3 bucket path for s3 cleanup (#14190)

* Improve documentation for Postgres Source (#13830)

* Improve documentation for Postgres Source
 * add information about additional JDBC params
 * add anchors for doc sections
 * fix link to CDC on Bare Metal
 * add more details about parsing date/time values
 * add doc link to SSH fields

* Handle null reset source config (#14202)

* handle null reset source config

* format

* Wait indefinitely if connection is not active (#14200)

* also wait indefinitely if connection is deleted

* fix test

* Bump Airbyte version from 0.39.26-alpha to 0.39.27-alpha (#14204)

Co-authored-by: lmossman <lmossman@users.noreply.github.com>

* Bmoric/feature flag for state deserialization (#14127)

* Add Feature flag

* Add default feature flag value

* Update test

* remove unsused

* tmp

* Update tests

* rm unwanted change

* PR comments

* [low-code connectors] default types and default values (#14004)

* default types and default values

* cleanup

* fixes so read works

* remove prints and trycatch

* comment

* remove unused param

* split file

* extract method

* extract methods

* comment

* optional

* fix test

* cleanup

* delete interpolated request header provider

* simplify next page url paginator interface

* comment

* format

* add state type endpoint (#14111)

* Bump Airbyte version from 0.39.27-alpha to 0.39.28-alpha (#14210)

Co-authored-by: sherifnada <sherifnada@users.noreply.github.com>

* 🐛 source-orbit: remove workspace_old.json (#14208)

* Fix: Docs plural login redirecting to wrong URL (#14207)

* [docs] fix numbering and incorrect filename in CDK docs (#13045)

* [docs] fix numbering in CDK docs

* Update 5-declare-schema.md

* Update 5-declare-schema.md

* Update 6-read-data.md

* Update 8-test-your-connector.md

* Remove the old scheduler from HelmCharts helper (#14187)

* Remove the old scheduler from HelmCharts helper

The old scheduler was removed as part of https://github.com/airbytehq/airbyte/pull/13400

* Remove legacy `scheduler` comment in HelmCharts

* Source Gitlab: add GroupIssueBoards stream (#13252)

* GitLab Source: add GroupIssueBoards stream

* Address stream schema comments

* Address comments

* Bump version

* Add as empty stream

* run seed file source (#14215)

* fix 'cannot reach server' error on demo instance (#10020)

* Update CODEOWNERS (#14209)

* 🎉 Source Github: use GraphQL for `reviews` stream (#13989)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* workflow for publishing artifacts for cloud (#14199)

* fix sentry org slug change (#14218)

* Source File: correct spec json to match json format (#13738)

* Upgrade spotless version and remove jvmargs workaround (#13705)

* Source Zendesk Chat: Process large amount of data in batches for incremental  (#14214)

* increased the limit of itens in request

* Configuration for max api pages on requests

* included api_pagination_limit in sample

* included api_pagination_limit in invalid_config

* creating new table for chat_session

* reverted api_pagination_limit approach

* removed api_pagination_limit from TimeIncrementalStream

* correct chat json

* bump connector version

* add changelog

* run format

* auto-bump connector version

Co-authored-by: Roberto Bonnet <robertojuarezwp@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Remove all @ts-ignore (#14221)

* Bump hadoop to use version 3.3.3 (#14182)

* Change the persistence activity to use the new persistence layer (#14205)

* Change the persistence activity to use the new persistence layer

* Use lombok

* format

* Use new State message helper

* Fix build (#14225)

* Fix build

* Fix test

* Use new state persistence for state reads (#14126)

* Inject StatePersistence into DefaultJobCreator
* Read the state from StatePersistence instead of ConfigRepository
* Add a conversion helper to convert StateWrapper to State
* Remove unused ConfigRepository.getConnectionState

* Temporal per stream resets (#13990)

* remove reset flags from workflow state + refactor

* bring back cancelledForReset, since we need to distinguish between that case and a normal cancel

* delete reset job streams on cancel or success

* extract isResetJob to method

* merge with master

* set sync modes on streams in reset job correctly

* format

* Add test for getAllStreamsForConnection

* fix tests

* update more tests

* add StreamResetActivityTests

* fix tests for default job creator

* remove outdated comment

* remove debug lines

* remove unused enum value

* fix tests

* fix constant equals ordering

* make job mock not static

* DRY and add comments

* add comment about deleted streams

* Remove io.airbyte.config.StreamDescriptor

* regisster stream reset activity impl

* refetch connection workflow when checking job id, since it may have been restarted

* only cancel if workflow is running, to allow reset signal to always succeed even if batched with a workflow start

* fix reset signal to use new doneWaiting workflow state prop

* try to fix tests

* fix reset cancel case

* add acceptance test for resetting while sync is running

* format

* fix new acceptance test

* lower sleep on test

* raise sleep

* increase sleep and timeout, and remove repeated test

* use CatalogHelpers to extract stream descriptors

* raise sleep and timeout to prevent transient failures

* format

Co-authored-by: alovew <anne@airbyte.io>

* fix PostgresJdbcSourceAcceptanceTest by activating the feature flag (#14240)

* fix PostgresJdbcSourceAcceptanceTest by activating the feature flag

* fix AbstractJdbcSourceAcceptanceTest as well

* fix expected_spec for strict encrypt

* [13539] Fix integration tests source-clickhouse Mac OS (#14201)

* [13539] Fix integration tests source-clickhouse Mac OS
fixed unit tests

* [13524] Fix integration tests destination-clickhouse Mac OS
fixed unit tests

* 6339: error when attempting to use azure sql database within an elastic pool as source for cdc based replication (#14121)

* 6339: implementation

* 6339: changelog updated

* 6339: definitions updated

* 6339: definitions reverted

* 6339: still struggling with publishing

* auto-bump connector version

* 6339: definitions reverted - correct

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* 🪟 🎨 Update favicon and table row image styles (#14020)

* style changes to favicon and imageblock

* fix import

* revert component and props names to block

* Update airbyte-webapp/src/components/ImageBlock/ImageBlock.tsx

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* Update airbyte-webapp/src/components/ImageBlock/ImageBlock.module.scss

Co-authored-by: Vladimir <volodymyr.s.petrov@globallogic.com>

* Update airbyte-webapp/src/components/ImageBlock/ImageBlock.tsx

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* Update airbyte-webapp/src/components/ImageBlock/ImageBlock.module.scss

Co-authored-by: Vladimir <volodymyr.s.petrov@globallogic.com>

* add storybook

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>
Co-authored-by: Vladimir <volodymyr.s.petrov@globallogic.com>

* upgrade potgresql version to fix default timestamp handling (#14211)

* implement logic to trigger snapshot of new tables via debezium (#13994)

* implement logic to trigger snapshot of new tables via debezium

* format

* improve test condition

* fix build

* BigQuery Denormalized "airbyte_type": "big_integer" to INT64 (#14079)

* BigQuery Denormalized "airbyte_type": "big_integer" to INT64

* updated changelog

* added unit test

* removed star import

* fixed checkstyle

* bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Add Metrics section to Scaling Airbyte doc (#14224)

* Added metrics section to scaling airbyte doc

* Updated URL in doc

* Deleted link

* Added link

* Added backslashes before brackets that aren't links

* Edited note about tagged metrics

* Changed list

* Changed spacing

* Changed spacing

* Changed spacing

* Deleted period

* Fixed broken firebolt link

* Added tables

* Cleaned up wording in tables

* Add ability to provide source/destination connector docker image (#14266)

* Add ability to provide source/destination connector docker image

* Make constant public

* Bump Airbyte version from 0.39.28-alpha to 0.39.29-alpha (#14232)

* disable flaky cmw test temporarily (#14269)

* release new postgres source connector version 0.4.29 (#14265)

* release new postgres source connector version 0.4.29

* add changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* :tada: Source Tiktok marketing - remove granularity config option (#13890)

* Removed granularity config option from spec, added corresponsing streams for each support granularity (hourly daily, lifetime), updated unittests, SAT

* auto-formating

* auto-formating

* removed AdvertisersIds stream from list of exposed streams, updated docs

* expose new style streams since 0.1.13, expose old streams for config for older version

* update spec

* fixed path to catalog

* increased timeout

* source bing-ads to ga (#13679)

* Source Tiktok marketing - increase connector version (#14272)

* increased connector version

* increased connector version in seed

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Fix flaky connection manager workflow test (#14271)

* try thread sleep instead of test env, and run 100 times

* replace testEnv.sleep with Thread.sleep in several tests

* replace RepeatedTest with Test

* replace testEnv.sleep with Thread.sleep after signals are executed

* run each test 100 times to see if any are flaky

* add log

* change repetitions to 100 to avoid out of memory

* format

* swap repeated test for normal test

* 13532 Fixed integration tests destination-mssql Mac OS (#14252)

* 13532 Fixed integration tests destination-mssql Mac OS

* Source Google Analytics: Specify integer for dimension ga:dateHourMinute (#14298)

* Specify integer for dimension ga:dateHourMinute
* Update changelog

* 🎉 Source Github: rename field `mergeable` to `is_mergeable` (#14274)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Update Airbyte Client (#14270)

* #12668 #13198 enable full refresh, disable incremental and expected_records (#14191)

* 🎉 Destination S3: update INSTANCE_PROFILE to use AWSDefaultProfileCredential (#14231)

Co-authored-by: Mike Balmer <remlabm@users.noreply.github.com>

* Source Zendesk Support: pagination group membership (#14304)

* add next_page_tooken and request

* correct group_membership paginatin

* update doc

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* 🪟 🐛 Fix OAuth validation not allowing to create source or destination (#14197)

* Enable "Set up source/destination" button only if the form is valid

* Update how ServiceForm initial values are patched so that it correctly patches the configuration with default values

* Update initial values patching in service form to use initialValues to preserve already set values
Update useOAuthFlowAdapter to correctly merge the values from the oauth response

* Remove unused values var from ServiceForm

* Add acceptance tests for per-stream state updates (#14263)

* Add acceptance tests for per-stream state updates

* PR feedback

* Formatting

* More PR feedback

* PR feedback

* Remove unused constant

* Make sure that the feature flag is transfer to container (#14314)

* Make sure that the feature flag is transfer to container

* propagate the feature flags

* Avoid propagating the feature flags

* Fix tests

* Source Postgres : use more simple and comprehensive query to get selectable tables (#14251)

* use more simple and comprehensive query to get selectable tables

* cover case when schema is not specified

* add test to check discover with different ways of grants

* format

* incr ver

* incr ver

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Fixed broken link

* Fix for deleting stream resets (#14322)

* Fix for deleting stream resets

* Fix build by updating var (#14321)

* Edited formatting (#14275)

* Avoid error when creating dupl stream reset (#14328)

* Bump Airbyte version from 0.39.29-alpha to 0.39.30-alpha (#14329)

Co-authored-by: lmossman <lmossman@users.noreply.github.com>

* Release new postgres strict encrypt version (#14331)

* Bump postgres strict encrypt version

* Update changelogs

* Update doc

* Release new destination s3 version to pick up latest change (#14332)

* Bump s3 version

* Update pr id

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* 13538 Fix integration tests destination-scylla Mac OS (#14308)

* 13538 Fix integration tests destination-scylla Mac OS

* Update cdk-speedrun.md (#14258)

Added a link at the bottom of the article , so the user may find the more in-depth tutorial about building a real-world connector.

* Update README.md (#14303)

Added a link to https://airbyte.com/tutorials/extract-data-from-the-webflow-api in Webflow's README.md

* Update building-a-python-source.md (#14262)

* Update webflow.md (#14254)

Added a link to the new blog - https://airbyte.com/tutorials/extract-data-from-the-webflow-api

Co-authored-by: Simon Späti <simu@sspaeti.com>

* Alex/declarative stream incremental fix (#14268)

* checkout files from test branch

* read_incremental works

* reset to master

* remove dead code

* comment

* fix

* Add test

* comments

* utc

* format

* small fix

* Add test with rfc3339

* remove unused param

* fix test

* 🐛 SingerSource: Fix incompatibilities and typing issues (#14148)

* Use logging.Logger in SingerSource

* Fix SingerSource ConfigContainer

This fixes typing issues with `ConfigContainer` and makes it compatible
with `split_config`. Fixes #8710.

* Fix SingerSource state and catalog typer issues

* Rename SingerSource method args to match parent classes

* Remove old comment about excluding Singer

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>

* Update source postgres release stage to beta (#14326)

* fix NPE (#14353)

* fix NPE

* Add test

* Fix trailing

* 🎉 octavia-cli: Add ability to import existing resources (#14137)

* helm chart: Add Image Pull Secrets Param  (#14031)

* fix format (#14354)

* Bump Airbyte version from 0.39.30-alpha to 0.39.31-alpha (#14355)

Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>

* tiktok to ga (#14358)

* Update state.state type (#14360)

* Run some DATs as part of base-normalization tests (#14312)

* Revert "🎉 Source Github: rename field `mergeable` to `is_mergeable` (#14274)" (#14338)

* Revert "🎉 Source Github: rename field `mergeable` to `is_mergeable` (#14274)"

* Properly update the hasEmitted state (#14367)

* Bmoric/state aggregator (#14364)

* Update state.state type

* Add state aggregator

* Test and format

* PR comments

* Move to its own package

* Update airbyte-workers/src/test/java/io/airbyte/workers/internal/state_aggregator/StateAggregatorTest.java

Co-authored-by: Lake Mossman <lake@airbyte.io>

* format

* Update airbyte-workers/src/main/java/io/airbyte/workers/internal/state_aggregator/DefaultStateAggregator.java

Co-authored-by: Lake Mossman <lake@airbyte.io>

* format

Co-authored-by: Lake Mossman <lake@airbyte.io>

* Bump Airbyte version from 0.39.31-alpha to 0.39.32-alpha (#14383)

Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>

* 🐛 Source Mixpanel: fix SAT tests (#14349)

* Call the new revoke_user_session endpoint from the FE (#13165)

* Source Instagram: change releaseStage to GA (#14162)

* Source Google Analytics: Change releaseStage to GA (#13957)

* source-outreach: fix record parsing and cursor field access (#14386)

* Kustomize: Use `resources` since `bases` is deprecated (#14037)

* fix: clone api doesn't take update configurations (#13592)

* fix: clone api doesn't take update configurations

* fix: you will be able to create clone in different workspace

* fix: added description to source/destination body

* cdk: Attach namespace to stream  in catalog (#13923)

* Source TiDB: correct jdbc string builder (#14243)

* add icon for tidb-connector

* Fix TiDB source connector

* bump connector version

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Source Google Ads: use docsaurus feature for warn/note and udpdate doc (#14392)

* use docsaurus feature for warn/note and udpdate doc

* update description in supported streams

* Source Facebook Marketing: allow configuration of MAX_BATCH_SIZE (#14267)

* Add max batch size config

* Bump semver

* add changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* 🎉 Source Github: add Retry for GraphQL API Resource limitations (#14376)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Add more metadata to the JobErrorReporter (#14395)

* add workspace_id and connector_repository as tags

* add tag for connection url

* fix urls for job notifier

* format

* fix failing test

* beta -> generally_available (#14315)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* helm chart: Fix/double printing of extra volume mounts (#14091)

* SentryJobErrorReporter: better handling of multiline chained java exceptions (#14398)

* Docs: deploy on gcp use docusaurus tabs (#14401)

* Revert "Kustomize: Use `resources` since `bases` is deprecated (#14037)" (#14415)

This reverts commit 5c9a6a5fc655a9e597f755be8fc8ccf805a2537a.

* Use Debezium Postgres image for CDC tests (#14318)

* Use Debezium Postgres image for CDC tests

* Formatting

* 🎉 octavia-cli: Add ability to import all resources (#14374)

* Bump Airbyte version from 0.39.32-alpha to 0.39.33-alpha (#14419)

Co-authored-by: pedroslopez <pedroslopez@users.noreply.github.com>

* 📝 MySql source: clarify tinyint to number conversion when size > 1 (#14424)

* 🪟 🐛 Fix Setup Source Button on OAuth Sources (#14413)

* don't disable setup button

* make eslint happy

* one more cleanup

* use the spec to decide how to create config object

* Bump Airbyte version from 0.39.33-alpha to 0.39.34-alpha (#14428)

Co-authored-by: timroes <timroes@users.noreply.github.com>

* [low-code cdk] Enable configurable state checkpointing (#14317)

* checkout files from test branch

* read_incremental works

* reset to master

* remove dead code

* comment

* fix

* Add test

* comments

* utc

* format

* small fix

* Add test with rfc3339

* remove unused param

* fix test

* configurable state checkpointing

* update test

* fix type hints (#14352)

* normalization: Do not return NULL for MySQL column values > 512 chars  (#11694)

Co-authored-by: Augustin <augustin.lafanechere@gmail.com>
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>
Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Tim Roes <tim@airbyte.io>
Co-authored-by: Charles <charles@airbyte.io>
Co-authored-by: Jonathan Pearlin <jonathan@airbyte.io>
Co-authored-by: Amruta Ranade <11484018+Amruta-Ranade@users.noreply.github.com>
Co-authored-by: Benoit Moriceau <benoit@airbyte.io>
Co-authored-by: Jimmy Ma <jimmy@airbyte.io>
Co-authored-by: Ganpat Agarwal <gagarwal@artica.com>
Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Rajakavitha Kodhandapani <krajakavitha@gmail.com>
Co-authored-by: Yevhen Sukhomud <suhomud@gmail.com>
Co-authored-by: Andrii Leonets <30464745+DoNotPanicUA@users.noreply.github.com>
Co-authored-by: George Claireaux <george@claireaux.co.uk>
Co-authored-by: VitaliiMaltsev <39538064+VitaliiMaltsev@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: sw-yx <shawnthe1@gmail.com>
Co-authored-by: Baz <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Octavia Squidington III <90398440+octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>
Co-authored-by: Eugene <etsybaev@gmail.com>
Co-authored-by: Denis Davydov <davydov.den18@gmail.com>
Co-authored-by: Anna Lvova <37615075+annalvova05@users.noreply.github.com>
Co-authored-by: Vladimir <volodymyr.s.petrov@globallogic.com>
Co-authored-by: Phlair <Phlair@users.noreply.github.com>
Co-authored-by: Parker Mossman <parker@airbyte.io>
Co-authored-by: Adam <adam-bloom@users.noreply.github.com>
Co-authored-by: Liren Tu <tuliren@gmail.com>
Co-authored-by: pmossman <pmossman@users.noreply.github.com>
Co-authored-by: Topher Lubaway <asimplechris@gmail.com>
Co-authored-by: Brian Lai <51336873+brianjlai@users.noreply.github.com>
Co-authored-by: Peter Hu <peter@airbyte.io>
Co-authored-by: Subodh Kant Chaturvedi <subodh1810@gmail.com>
Co-authored-by: Tuhai Maksym <kimerinn@gmail.com>
Co-authored-by: Alexander Marquardt <alexander.marquardt@gmail.com>
Co-authored-by: sajarin <sajarindider@gmail.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: steve withington <steve@digitalmine.com>
Co-authored-by: Leo Sussan <leosussan@gmail.com>
Co-authored-by: cenegd <cenegd@live.com>
Co-authored-by: Tomas Perez Alvarez <72174660+Tomperez98@users.noreply.github.com>
Co-authored-by: Lake Mossman <lake@airbyte.io>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Yurii Bidiuk <yura.bidyuk@gmail.com>
Co-authored-by: Christophe Duong <christophe.duong@gmail.com>
Co-authored-by: Teal Larson <LARSON.TEAL@GMAIL.COM>
Co-authored-by: Sophia Wiley <106352739+sophia-wiley@users.noreply.github.com>
Co-authored-by: jdpgrailsdev <jdpgrailsdev@users.noreply.github.com>
Co-authored-by: Jimmy Ma <gosusnp@users.noreply.github.com>
Co-authored-by: Stella Chung <schung507@gmail.com>
Co-authored-by: Amanda Murphy <amanda.murphy@heapanalytics.com>
Co-authored-by: Mohamed Magdy <mohamed.magdy@canary.is>
Co-authored-by: nataly <nataly@airbyte.io>
Co-authored-by: Tyler Russell <tylerrussell85@gmail.com>
Co-authored-by: Alexander Tsukanov <alexander.tsukanovvv@gmail.com>
Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
Co-authored-by: brianjlai <brianjlai@users.noreply.github.com>
Co-authored-by: terencecho <terence@airbyte.io>
Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: terencecho <terencecho@users.noreply.github.com>
Co-authored-by: Daniel Diamond <33811744+danieldiamond@users.noreply.github.com>
Co-authored-by: drrest <dr.rest@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
Co-authored-by: Zawar Khan <zawar.khan@getmercury.io>
Co-authored-by: ptiurin <petro.tiurin@firebolt.io>
Co-authored-by: Greg Solovyev <grishick@users.noreply.github.com>
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
Co-authored-by: sherifnada <sherifnada@users.noreply.github.com>
Co-authored-by: Sachin Jangid <sachinjangid832@gmail.com>
Co-authored-by: Chris Wu <chris@faros.ai>
Co-authored-by: Jared Rhizor <me@jaredrhizor.com>
Co-authored-by: tison <wander4096@gmail.com>
Co-authored-by: Roberto Bonnet <robertojuarezwp@gmail.com>
Co-authored-by: Malik Diarra <malik@airbyte.io>
Co-authored-by: alovew <anne@airbyte.io>
Co-authored-by: Oleksandr Sheheda <alexandr-shegeda@users.noreply.github.com>
Co-authored-by: midavadim <midavadim@yahoo.com>
Co-authored-by: Arsen Losenko <20901439+arsenlosenko@users.noreply.github.com>
Co-authored-by: Ryan Lewon <ryan@segv.net>
Co-authored-by: Mike Balmer <remlabm@users.noreply.github.com>
Co-authored-by: Anne <102554163+alovew@users.noreply.github.com>
Co-authored-by: Liren Tu <tuliren.git@outlook.com>
Co-authored-by: Simon Späti <simu@sspaeti.com>
Co-authored-by: Albin Skott <cstruct@users.noreply.github.com>
Co-authored-by: Caleb Fornari <calebfornari@gmail.com>
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
Co-authored-by: Christian Martin <christian@ctmartin.me>
Co-authored-by: jordan-glitch <65691557+jordan-glitch@users.noreply.github.com>
Co-authored-by: Daemonxiao <35677990+Daemonxiao@users.noreply.github.com>
Co-authored-by: Keith Thompson <keithjoethompson@gmail.com>
Co-authored-by: Leo Sussan <leo@reach.vote>
Co-authored-by: pedroslopez <pedroslopez@users.noreply.github.com>
Co-authored-by: timroes <timroes@users.noreply.github.com>
Co-authored-by: Johannes Nicolai <jonico@planetscale.com>
shrodingers added a commit to Brigad/airbyte that referenced this pull request Jul 6, 2022
@shrodingers @alafanechere
@edmundito @evantahler @timroes @cgardens @jdpgrailsdev @Amruta-Ranade @benmoriceau @gosusnp @ganpatagarwal @grubberr @Rajakavitha1 @suhomud @DoNotPanicUA @Phlair @VitaliiMaltsev @octavia-squidington-iii @swyxio @bazarnov @etsybaev @davydov-d @annalvova05 @dizel852 @pmossman @adam-bloom @tuliren @supertopher @brianjlai @git-phu @subodh1810 @kimerinn @alexander-marquardt @sajarin @marcosmarxm @girarda @stevewithington @leosussan @ss098 @Tomperez98 @lmossman @sherifnada @edgao @yurii-bidiuk @ChristopheDuong @teallarson @sophia-wiley @schung507 @mohamagdy @terussell85 @alexandertsukanov @pedroslopez @terencecho @davinchia @danieldiamond @drrest @avaidyanatha @harshithmullapudi @Zawar92 @ptiurin @grishick @gittysachin @cjwooo @jrhizor @tisonkun @RobertoBonnet @malikdiarra @alovew @alexandr-shegeda @midavadim @arsenlosenko @xorl @remlabm @sspaeti @cstruct @calebfornari @ct-martin @jordan-glitch @Daemonxiao @keiththompson @jonico
Shrodingers/destination databricks dbt (#1)
0232182 
* octavia-cli: fix workspace not having anonymous_data_collection property (#13869)

* Update connection update calls to use central utility to ensure connection update has all data (#13564)

* Update connection updates with build update utility
* Add buildConnectionUpdate utility
* Update components that update the connection to use utility when necessary

* Use conection name when saving connection from replication view to prevent override from refreshed catalog

* Improve connection check on ReplicationView onSubmit function

* Display connection state in connection setting page (#13394)

* Display Connection State in Setting page

* memoize callback

* rendering and confirmaton

* setState API

* Input validation

* remove JSON step

* rename apiMethod to `updateState`

* test and adjust route

* skip if sync is running

* prevent state update when sync is running

* code editor component

* errors fixed

* scss style

* make linter happy

* Back to monaco editor

* Remove ability to edit state

* Adjust FE code

* Fix CSS problem

* Update airbyte-webapp/src/locales/en.json

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* just use PRE to render state for now

Co-authored-by: Tim Roes <tim@airbyte.io>
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* update api for per stream (#13835)

* Update airbyte-protocol.md (#13892)

* Update airbyte-protocol.md

* Fix typo

* Fix prose

* Add protocol reviewers for protocol documentation

* Remove duplicate

* Edited Amplitude, Mailchimp, and Zendesk Support docs (#13897)

* deleting SUMMARY.md since we don't need it for docusaurus builds (#13901)

* Do not hide unexpected errors in the check connection (#13903)

* Do not hide unexpected errors in the check connection

* Fix test

* Common code to deserialize a state message in the new format (#13772)

* Common code to deserialize a state message in the new format

* PR comments and type changed to typed

* Format

* Add StateType and StateWrapper objects to the model

* Use state wrapper instead of Either

* Switch to optional

* PR comments

* Support array legacy state

* format

Co-authored-by: Jimmy Ma <jimmy@airbyte.io>

* 🐛 Source Amazon Seller Partner: handle start date for financial stream (#13633)

* start and end date for finacial stream should not be more than 180 days apart

* improve unit tests

* make changes to start date for finance stream

* update tests

* lint changes

* update version to 0.2.22 for source-amazon-seller-partner

* Normalization: Fix incorrect jinja2 macro `json_extract_array` call (#13894)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Docs: fixed the broken links (#13915)

* 0.2.5 -> 0.2.6 (#13924)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* 13546 Fix integration tests source-postgres Mac OS (#13872)

* 13546 Fix integration tests source-postgres Mac OS

* 13548 Fixed integration tests source-tidb Mac OS (#13927)

* Source MsSql : incr ver to include changes #13854 (#13887)

* incr version

* put PR id

* docker ver

* connectors that published (#13932)

* Deprecate PART_SIZE_MB in connectors using S3/GCS storage (#13753)

* Removed part_size from connectors that use StreamTransferManager

* fixed S3DestinationConfigTest

* fixed S3JsonlFormatConfigTest

* upadate changelog and bump version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* upadate changelog and bump version for Redshift and Snowflake destinations

* auto-bump connector version

* fix GCS staging test

* fix GCS staging test

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Reverted changes in SshBastionContainer (#13934)

* 🎉 New Source Dockerhub (#13931)

* init

* implement working source + tests

* add docs

* add docs

* fix bad comments

* Update airbyte-integrations/connectors/source-dockerhub/acceptance-test-config.yml

* Update airbyte-integrations/connectors/source-dockerhub/Dockerfile

* Update airbyte-integrations/connectors/source-dockerhub/.dockerignore

* Apply suggestions from code review

* Update docs/integrations/sources/dockerhub.md

* Update airbyte-integrations/connectors/source-dockerhub/integration_tests/acceptance.py

Co-authored-by: George Claireaux <george@airbyte.io>

* address @Phlair's feedback

* address @Phlair's feedback

* each record is now a Docker image rather than response page

* format

* fix unit tests

* fix acceptance tests

* add icon, definition and generate seed spec

* add requests to requirements

Co-authored-by: sw-yx <shawnthe1@gmail.com>

* commented out non-relevant tests (#13940)

* Bump Airbyte version from 0.39.20-alpha to 0.39.21-alpha (#13938)

Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>

* newaction (#13942)

* remove test action (#13944)

* 🎉Source-mysql: aligned datatype test (#13945)

* [13607] source-mysql: aligned datatype tests for regular and CDC ways + added CHAR fix to CDC processing

* #13958 Source Stripe: fix configured catalogs (#13959)

* 🐛 Source: Typeform - Update schema for Responses stream (#13935)

* Upd responses schema

* Upd docs

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* :window: Updated email invitation flow that enables invited users to set name and create password (#12788)

* First pass accepting email link invitation
* Update Auth service with signInWithEmailLink calls
* Add AcceptEmailInvite component
* Update FirebaseActionRoute to handle sign in mode
* Rename ResetPasswordAction to FirebseActionRoute

* Add create password setp to AcceptEmailInvite component

* Remove continueURL from invite fetch

* Update accept email invite for user to enter both email and password together

* Set name during email link signup

* Update AcceptEmailInvite to send name
* Add updateName to UserService
* Update AuthService to set name during sign up

* Remove steps from AcceptEmailInvite component
Remove setPassword from AuthService

* Add header and title to accept invite page

* Move invite error messages to en file

* For invite link pages, show login link instead of sign up

* Disable name update on sign in via email lnk

* Resend email invite when the invite link is expired

* Fix status message in accept email invite page

* Re-enable set user's name during sign up email invite

* Update signUpWithEmailLink so that sign up is successful even if we fail to update the user's name

* Update comments on GoogleAuthService signInWithEmailLink

* Add newsletter and accept terms checkboxes to accept email invite component
* Extract signup form from signup page
* Extract fields from signup form
* Update accept email invite component to use field components from signup form
* Ensure that sign up button is disable until form is valid and security checkbox is checked

* Make error status text color in accept email link red

* Update workspace check in DefaultView so that user lands in workspace selector when there are no workspaces

* Add coment around continueUrl param usage in UserService

* Remove usless default case in GoogleAuthService

* Source Marketo: process fail during creation of an export job (#13930)

* #9322 source Marketo: process fail during creation of an export job

* #9322 source marketo: upd changelog

* #9322 source marketo: fix unit test

* #9322 source marketo: fix SATs

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* :window: :wrench: Add eslint rules for CSS modules (#13952)

* add eslint-plugin-css-modules rules

* Fixes:
- turn on eslint css modules rule as error
- remove unused styles

* add warning message if styled components is used

* Revert "add warning message if styled components is used"

This reverts commit 4e92b8b2110142bb679f15aeb034e377e0dcc69c.

* replace rule severity with words

* Update salesforce.md

Fixed broken link

* :window: 🔧 Add auto-fixable linting rules to webapp (#13462)

* Add new eslint rules that fit with our code style and downgrade rules to warn

* allowExpressions in fragment eslint rule

* Enable function-component-definition in eslint and fix styles

* Cleanup lint file

* Fix react/function-component-definition warnings manually

* Add more auto-fixable rules and fix

* Fix functions that require usless returns

* Update array-type rule to array-simple

* Fix eslint errors manually
disable assignmentExpression for arrays in prefer-destructuring rule

* Auto fix new linting issues after rebase

* Enhance /publish to allow for multiple connectors and parallel execution (#13864)

* start

* revert

* azblob

* bq

* bq denorm

* megapublish baaaabyyyy

* fix needs

* matrix connectors

* auto-bump connector version

* dont failfast and max parallel 5

* multi runno

* minor

* testing matrix agents

* name

* testing multi agents

* tmp fix

* new multi agents

* multi test

* tryy

* let's do this

* magico

* fix

* label test

* couple more connector bumps

* temp

* things

* check this

* lets gooo

* more connectors

* Delete TEMP-testing-command.yml

* auto-bump connector version

* added comment describing bash part

* running single thread

* catch sentry cli

* auto-bump connector version

* destinations

* + snowflake

* saved

* auto-bump connector version

* auto-bump connector version

* java source bumps

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* remove twice-defined methods

* label things

* revert action

* using the new test action

* point at action

* wrong tag on action

* update pool label

* update to use new ec2-github-runner fork

* this needs to be more generic than publisher

* change publish to run on pool

* add comment about runner-pool usage

* updated publish command docs for multi & parallel connector runs

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* unbump failed publish versions

* missed dockerfiles

* remove failed docs

* mssql fix

* overhauled the git comment output

* bumping a test connector that should work

* slight order switcheroo

* output connectors properly in first message

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Bump Airbyte version from 0.39.21-alpha to 0.39.22-alpha (#13979)

Co-authored-by: Phlair <Phlair@users.noreply.github.com>

* Parker/temporal cloud (#13243)

* switch to temporal cloud client for now

* format

* use client cert/key env secret instead of path to secret

* add TODO comments

* format

* add logging to debug timeout issue

* add more logging

* change workflow task timeout

* PR feedback: consolidate as much as possible, add missing javadoc

* fix acceptance test, needs to specify localhost

* add internal-use only comments

* format

* refactor to clean up TemporalClient and prepare it for future dependency injection framework

* remove extraneous log statements

* PR feedback

* fix test

* return isInitialized true in test

* 📄  Postgres source: fix CDC setup order in docs (#13949)

* postgres source: fix CDC setup order docs

* Update docs/integrations/sources/postgres.md

Co-authored-by: Liren Tu <tuliren@gmail.com>

* Per-stream state support for Postgres source (#13609)

* WIP Per-stream state support for Postgres source

* Fix failing test

* Improve code coverage

* Make global the default state manager

* Add legacy adapter state manager

* Formatting

* Include legacy state for backwards compatibility

* Add global state manager

* Implement Global/CDC state handling

* Fix test issues

* Fix issue with updated method signature

* Handle empty state case in global state manager

* Adjust to protocol changes

* Fix failing acceptance tests

* Fix failing test

* Fix unmodifiable list issue

* Fix unmodifiable exception

* PR feedback

* Abstract global state manager selection

* Handle conversion between different state types

* Handle invalid conversion

* Rename parameter

* Refactor state manager creation

* Fix failing tests

* Fix failing integration tests

* Add CDC test

* Fix failing integration test

* Revert change

* Fix failing integration test

* Use per-stream for postgres tests

* Formatting

* Correct stream descriptor validation

* Correct permalink

* PR feedback

* Bump Airbyte version from 0.39.22-alpha to 0.39.23-alpha (#13984)

Co-authored-by: pmossman <pmossman@users.noreply.github.com>

* Adds test for new workflow (#13986)

* Adds test for new workflow

* Adds airbyte repo

* remove testing line

* Add new InterpolatedRequestOptionsProvider that encapsulates all variations of request arguments (#13472)

* write out new request options provider and refactor components and parts of the YAML config

* fix formatting

* pr feedback to consolidate body_data_provider to simplify the code

* pr feedback get rid of extraneous optional

* publish oss for cloud (#13978)

workflow to publish oss artifacts that cloud needs to build against
use docker buildx to create arm images for local development

* skip debezium engine startup in case no table is in INCREMENTAL mode (#13870)

* 🎉 Source Github: break point added for workflows_runs stream (#13926)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* 6339: error when attempting to use azure sql database within an elastic pool as source for cdc based replication (#13866)

* 6339: debug info

* 6339: not using 'USE' on Azure SQL servers

* 6339: cleanup

* 6339: cleanup2

* 6339: cleanup3

* 6339: versions/changelogs updated

* 6339: merge from master (consolidation issue)

* 6339: dev connector version (for testing in airbyte cloud)

* 6339: code review implementation

* 6339: apply formatting

* in case runners fail to spin up, this needs to run on github-hosted (#13996)

* 12708: Add an option to use encryption with staging in Redshift Destination (#13675)

* 12708: Add an option to use encryption with staging in Redshift Destination

* 12708: docs/docker configs updated

* 12708: merge with master

* 12708: merge fix

* 12708: code review implementation

* 12708: fix for older configs

* 12708: fix for older configs in check

* 12708: merge from master (consolidation issue)

* 12708: versions updated

* :tada: New Source: Webflow (#13617)

* Added webflow code

* Updated readme

* Updated README

* Added webflow to source_definitions.yaml

* Enhanced documentation for the Webflow source connector

* Improved webflow source connector instructions

* Moved Site ID to before API token in Spec.yaml (for presentation in the UI)

* Addressed comments in PR.

* Changes to address requests in PR review

* Removed version from config

* Minor udpate to spec.yaml for clarity

* Updated to pass the accept-version as a constant rather than parameter

* Updated check_connection to hit the collections API that requires both site id and the authentication token.

* Fixed the test_check_connection to use the new check_connection function

* Added a streams test for generate_streams

* Re-named "autentication" object to "auth" to be more consistent with the way it is created by the CDK

* Added in an explict line to instantiante an "auth" object from WebflowTokenAuthenticator, to make it easier to describe in the blog

* Fixed a typo in a comment

* Renamed some classes to be more intuitive

* Renamed class to be more intuitive

* Minor change to an internal method name

* Made _get_collection_name_to_id_dict staticmethod

* Fixed a unit-test error that only appeared when running " python -m pytest -s unit_tests".
This was caused by Mocked settings from test_source.py leaking into test_streams.py

* format: add double quotes and remove unused import

* readme: remove semantic version naming of connector in build commands

* Updated spec.yaml

* auto-bump connector version

* format files

* add changelog

* update dockerfile

* auto-bump connector version

Co-authored-by: sajarin <sajarindider@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>

* Source-oracle: fixed tests + checkstyle (#13997)

* Source-oracle: fixed tests + checkstyle

* 🐛Destination-mysql: fixed integration test and build process (#13302)

* [13180] destination-mysql: fixed integration test

* update changelog to include debezium version upgrade (#13844)

* make table headers look less like successes (#13999)

* source-twilio: implement lookback windows (#13896)

* Revert "12708: Add an option to use encryption with staging in Redshift Destination (#13675)" (#14010)

This reverts commit aa28d448d820df9d79c2c0d06b38978d1108fb2c.

* Revert "6339: error when attempting to use azure sql database within an elastic pool as source for cdc based replication (#13866)" (#14011)

This reverts commit 0d870bd37bc3b5cd798b92115d73bcc45a42d8f7.

* [low-code connectors] BasicHttpAuthenticator (#13733)

* implement basichttpauthenticator

* add optional refresh access token authenticator

* remove prints

* type hints

* Fix and unit test

* missing test

* Add class to __init__ file

* Add comment

* migrate JsonSchemas to use basic path instead of JSONPath (#13917)

* scaffold for catalog diff, needs fixing on type handling and tests (#13786)

* Prepare release of JDBC connectors (#13987)

* Prepare release of JDBC connectors

* Update source definitions manually

* use built in check for if path is definite (#13834)

* 13535 Fixed bastion network for integration tests (#14007)

* doc: add error troubleshooting `docker-compose up` (#13765)

* fix: duplicate resource allocations in `airbyte-temporal` deployment (#13816)

* helm-chart: Fix worker deployment format error (#13839)

* add catalog diff connection read (#13918)

* doc: fix small typo on Shopify documentation (#13992)

* add streams to reset to job info (#13919)

* Generate api for changes in #13370 and make code compatible (#14014)

* Generate api for per-stream updates #13835 (#14021)

* Revert "Prepare release of JDBC connectors (#13987)" (#14029)

This reverts commit df759b30778082508e2872513800fac34d98ff7c.

* Fix per stream state protocol backward compatibility (#14032)

* rename state type field to fix backwards compatibility issue

* replace usages of stateType with type

* support semi incremental by adding extractor record filter (#13520)

* support semi incremental by adding extractor record filter

* refactor extractor into a record_selector that supports extraction and filtering of response records

* Remove pydantic spec from amazon ads and use YAML spec (#13988)

* add EdDSA support in SSH tunnel (#9494)

* add EdDSA support

* verify EdDSA support works correct

Co-authored-by: Yurii Bidiuk <yura.bidyuk@gmail.com>

* 🎉New source connector: source-metabase (#13752)

* Add docs

* Close metabase session when sync finishes

* Close session in check_connection

* Add source definition to seed

* Add icon

* improve cdc check for connectors (#14005)

* improve should use cdc check

* Revert "improve should use cdc check"

This reverts commit 7d01727279d21d33a6c18ed3227ee94432636120.

* improve should use cdc check

* add unit test

* Update webflow.md

* Update webflow.md

* Update webflow.md

* Remove legacy sentry code from cdk (#14016)

* rip sentry out of cdk

* remove sentry dsn from gsc

* Update webflow.md

* Update webflow.md

* Fixed broken links (#14071)

* 🪟Persist unsaved changes on schema refresh (#13895)

* add form values tracker context

* add clarifying comment

* add same functionality to create connection

* Update airbyte-webapp/src/components/CreateConnectionContent/CreateConnectionContent.tsx

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* Fixes broken links so we can deploy again (#14075)

also adds better error message for when this happens to others

* Adds symmary.md to gitignore (#14078)

* Added webflow icon (#14069)

* Added webflow icon

* Added icon

* Build create connection form build failure (#14081)

* Fix CDK obfuscation of nested secrets (#14035)

* Added Buy Credits section to Managing Airbyte Cloud (#13905)

* Added Buy Credits section to Managing Airbyte Cloud

* Made some style changes

* Made edits based on Natalie's suggestions

* Deleted link

* Deleted line

* Edited email address

* Updated reaching out to sales sentence

* disable es-lit to fix build (#14087)

* Release source connectors (#14077)

* Release source connectors

* Fix issue with database connection in test

* Fix failing tests due to authentication

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Bump Airbyte version from 0.39.23-alpha to 0.39.24-alpha (#14094)

Co-authored-by: jdpgrailsdev <jdpgrailsdev@users.noreply.github.com>

* Emit the state to remove in the airbyte empty source (#13725)

What
This PR updates the EmptyAirbyteSource in order to perform a partial update and handle the new state message format.

How
The empty will now emit different messages based on the type of state being provided:

Per stream: it will emit one message per stream that have been reset
Global: It will emit one global message that will contain null for the stream that have been reset including the shared state
Co-authored-by: Jimmy Ma <jimmy@airbyte.io>

* Add StatePersistence object (#13900)

Add a StatePersistence object that supports Read/Writes of States to the DB with StreamDescriptor fields

The only migrations that is supported are
* moving from LEGACY to GLOBAL
* moving from LEGACY to STREAM
* All other state type migrations are expected to go through an explicit reset beforehand.

* secret-persistence: Hashicorp Vault Secret Store (#13616)

Co-authored-by: Amanda Murphy <amanda.murphy@heapanalytics.com>
Co-authored-by: Benoit Moriceau <benoit@airbyte.io>

* 🐛 Source Hubspot: remove `AirbyteSentry` dependency (#14102)

* fixed

* updated changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* fix: format VaultSecretPersistenceTest.java (#14110)

* Source Hubspot: extend error logging (#14054)

* #291 incall - source Hubspot: extend error logging

* huspot: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Update webflow.md (#14083)

* Update webflow.md

Removed a description that is only applicable to people that are writing connector code, not to _users_ of the connector.

* Update webflow.md

* Update webflow.md

* Update webflow.md

* Update webflow.md

* 12708: Add an option to use encryption with staging in Redshift Desti… (#14013)

* 12708: Add an option to use encryption with staging in Redshift Destination (#13675)

* 12708: Add an option to use encryption with staging in Redshift Destination

* 12708: docs/docker configs updated

* 12708: merge with master

* 12708: merge fix

* 12708: code review implementation

* 12708: fix for older configs

* 12708: fix for older configs in check

* 12708: merge from master (consolidation issue)

* 12708: versions updated

* 12708: specs updated

* 12708: specs updated

* 12708: removing autogenerated files from PR

* 12708: changelog updated

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Source PayPal Transaction: Update Transaction Schema (#13682)

* Update transaction schema.
* Transform money values from strings to floats or integers.

Co-authored-by: nataly <nataly@airbyte.io>
Co-authored-by: Augustin <augustin.lafanechere@gmail.com>

* fix(jsonSchemas): raise error when items property not provided (#14018)

* fix stream name in stream transformation update (#14044)

* 🐛 Destination Redshift: Improved discovery for redshift-destination not SUPER streams (#13690)

airbyte-12843: Improved discovery for redshift-destination not SUPER tables, excluded views from discovery.

* Remove skiptests option (#14100)

* update sentry release script (#14123)

* Remove "additionalProperties": false from specs for connectors with staging (#14114)

* Remove "additionalProperties": false from spec for connectors with staging

* Remove "additionalProperties": false from spec for Redshift destination

* bump versions

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* [14003] source-oracle: added custom jdbc field (#14092)

* [14003] source-oracle: added custom jdbc field

* Add JobErrorReporter for sending sync job connector failures to Sentry (#13899)

* skeleton for reporting connector errors to sentry

* report on job failures instead of attempt failures

* report sync job failures with relevant metadata using JobErrorReporter

* send stack traces from python connectors to sentry

* test JobCreationAndStatusUpdate and JobErrorReporter

* logs

* refactor into helper, initial tests

* using sentry

* run format

* load reporting client from env

* load sentry dsn from env

* send java stack traces to sentry

* test sentryclient, refactor to use Hub instance

* ErrorReportingClient.report -> .reportJobFailureReason

* inject exception helper, test stack trace parse error tagging

* rm logs

* more stack trace tests

* remove logs

* fix failing tests

* rename ErrorReportingClient to JobErrorReportingClient

* rename vars in docker-compose

* Return an Optional instead of null when parsing stack traces

* dont remove airbyte prefix when setting release name

* from_trace_message static

* remove failureSummary from jobfailure input, get from Job

* send stacktrace string if we weren't able to parse

* set deployment mode tag

* update .env

* just log if something goes wrong

* Use StateMessageHelper in source (#14125)

* Use StateMessageHelper in source

* PR feedback and formatting

* More PR feedback

* Revert change

* Revert changes

* Bump Airbyte version from 0.39.24-alpha to 0.39.25-alpha (#14124)

Co-authored-by: brianjlai <brianjlai@users.noreply.github.com>

* Refactor acceptance tests and utils (#13950)

* Refactor Basic acceptance tests and utils

* Refactor Advanced acceptance tests and utils

* Remove unused code

* Clear destination db data during cleanup

* Cleanup comments

* cleanup init code

* test creating new desintation db for each test

* cleanup desintation db init

* Allow to edit api client

* pull in temporal cloud changes

* Rename helper to harness; set some funcs to private; turn init into constructor

* add func to set env vars instead of using static vars and move some functionality out of init into acceptance tests

* update javadoc

Co-authored-by: Davin Chia <davinchia@gmail.com>

* fix javadoc formatting

* fix var naming

Co-authored-by: Davin Chia <davinchia@gmail.com>

* Bump Airbyte version from 0.39.25-alpha to 0.39.26-alpha (#14141)

Co-authored-by: terencecho <terencecho@users.noreply.github.com>

* 🎉 octavia-cli: Add ability to get existing resources (#13254)

* 13541 Fixed integration tests source-db2 Mac OS (#14133)

* 13523 Fix integration tests destination-cassandra Mac OS (#14134)

* 🐛 Source Hubspot: fixed SAT test, commented out expected_records (#14140)

* :bug: Source Intercom: extend `Contacts` schema with new properties (#14099)

* Source Twilio: adopt best practices (#14000)

* #1946 Source twilio: aopt best practices - tune tests

* #1946 add expected_records to acceptance-test-config.yml

* #1946 source twilio - upd schema and changelog

* #1946 fix expected_records

* #1946 source twilio: rm alerts from expected records as they expire in 30 days

* #1946 source twilio: bump version

* 🎉 Source BingAds:  expose hourly/daily/weekly/monthly options from configuration (#13801)

* #12489 - expose hourly/daily/weekly/monthly reports in discovery by default instead of in the connector's configuration settings

removed:  config settings for hourly/daily/weekly/monthly reports
added:    default value for all periodic reports to True

* #12489 - expose hourly/daily/weekly/monthly reports in discovery by default instead of in the connector's configuration settings

removed:  unused class variables, if-statement

* #12489 - expose hourly/daily/weekly/monthly reports in discovery by default instead of in the connector's configuration settings

removed:  unused variables from config

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* remove VersionMismatchServer (#14076)

* remove VersionMismatchServer

* remove VersionMismatchServerTest

* revert intended changes

* Increase instance termination time limit to 3 hours to accommodate connector builds. (#14181)

* Use correct bash comment symbol. (#14183)

* 🎉 New Source: Orbit.love (#13390)

* source-orbit: add definition and specs (#14189)

* 🎉 Base Norrmalization: clean-up Redshift `tmp_schemas` after SAT (#14015)

Now after `base-normalization` SAT the Destination Redshift will be automatically cleaned up from test leftovers. Other destinations are not covered yet.

* Source Salesforce: fix customIntegrationTest for SAT (#14172)

* Source Amazon Ads: increase timeout for SAT (#14167)

* 🎉  Introduce Google Analytics Data API source (#12701)

* Introduce Google Analytics Data API source

https://developers.google.com/analytics/devguides/reporting/data/v1

* Add Google Analytics Data API source PR link

* Add `client` class for Google Analytics Data API

* Move dimensions and metrics extraction to the `client` class

In the Google Analytics Data API

* Change the copyright date to 2022 in Google Analytics Data API

* fix: removing incremental syncs

* fix: change project_id to string

* fix: flake check is failing

* chore: added it to source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>

* 🐛 Destination Redshift: use s3 bucket path for s3 staging operations (#13916)

* Publish acceptance test utils maven artifact (#14142)

* Fix StatePersistence Legacy read/write (#14129)

StatePersistence will wrap/unwrap legacy state on write/read to ensure
compatibility with the old behavior/data.

* 🎉 Destination connectors: Improved "SecondSync" checks in Standard Destination Acceptance tests (#14184)

* [11731] Improved "SecondSync" checks in Standard Destination Acceptance tests

* 🐛 Source Zendesk Support: fixed "Retry-After" non integer value (#14112)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Source Tiktok Marketing: Videometrics (#13650)

* added video metrics in streams.py

* common metrics list updated.

* updated streams.py with extended metrics required.

* updated stream_test

* updated configured_catalog

* video metrics required list updated.

* chore: formatting

* chore: bump version in source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>

* 🎉 Source Github: secondary rate limits has to retry (#13955)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Harshith/test pr 13118 (#14192)

* Firebolt destination

* feat: Write method dropdown

* feat: Use future-proof Auth in SDK

* refactor: Move writer instantiation

* fix: tests are failing

* fix: tests are failing

* fix: tests are failing

* chore: added connector to definitions

* fix: formatting and spec

* fix: formatting for orbit

Co-authored-by: ptiurin <petro.tiurin@firebolt.io>

* 🪟 :art: Show credit usage on chart's specific day (#13503)

* add tooltip to chart

* Fixes:
- update main chart color;
- change onHover background color

* change chart color pallet to grey 500

* update color reference

* remove opacity from UsageCell

* 🐛 destination-redshift: use s3 bucket path for s3 cleanup (#14190)

* Improve documentation for Postgres Source (#13830)

* Improve documentation for Postgres Source
 * add information about additional JDBC params
 * add anchors for doc sections
 * fix link to CDC on Bare Metal
 * add more details about parsing date/time values
 * add doc link to SSH fields

* Handle null reset source config (#14202)

* handle null reset source config

* format

* Wait indefinitely if connection is not active (#14200)

* also wait indefinitely if connection is deleted

* fix test

* Bump Airbyte version from 0.39.26-alpha to 0.39.27-alpha (#14204)

Co-authored-by: lmossman <lmossman@users.noreply.github.com>

* Bmoric/feature flag for state deserialization (#14127)

* Add Feature flag

* Add default feature flag value

* Update test

* remove unsused

* tmp

* Update tests

* rm unwanted change

* PR comments

* [low-code connectors] default types and default values (#14004)

* default types and default values

* cleanup

* fixes so read works

* remove prints and trycatch

* comment

* remove unused param

* split file

* extract method

* extract methods

* comment

* optional

* fix test

* cleanup

* delete interpolated request header provider

* simplify next page url paginator interface

* comment

* format

* add state type endpoint (#14111)

* Bump Airbyte version from 0.39.27-alpha to 0.39.28-alpha (#14210)

Co-authored-by: sherifnada <sherifnada@users.noreply.github.com>

* 🐛 source-orbit: remove workspace_old.json (#14208)

* Fix: Docs plural login redirecting to wrong URL (#14207)

* [docs] fix numbering and incorrect filename in CDK docs (#13045)

* [docs] fix numbering in CDK docs

* Update 5-declare-schema.md

* Update 5-declare-schema.md

* Update 6-read-data.md

* Update 8-test-your-connector.md

* Remove the old scheduler from HelmCharts helper (#14187)

* Remove the old scheduler from HelmCharts helper

The old scheduler was removed as part of https://github.com/airbytehq/airbyte/pull/13400

* Remove legacy `scheduler` comment in HelmCharts

* Source Gitlab: add GroupIssueBoards stream (#13252)

* GitLab Source: add GroupIssueBoards stream

* Address stream schema comments

* Address comments

* Bump version

* Add as empty stream

* run seed file source (#14215)

* fix 'cannot reach server' error on demo instance (#10020)

* Update CODEOWNERS (#14209)

* 🎉 Source Github: use GraphQL for `reviews` stream (#13989)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* workflow for publishing artifacts for cloud (#14199)

* fix sentry org slug change (#14218)

* Source File: correct spec json to match json format (#13738)

* Upgrade spotless version and remove jvmargs workaround (#13705)

* Source Zendesk Chat: Process large amount of data in batches for incremental  (#14214)

* increased the limit of itens in request

* Configuration for max api pages on requests

* included api_pagination_limit in sample

* included api_pagination_limit in invalid_config

* creating new table for chat_session

* reverted api_pagination_limit approach

* removed api_pagination_limit from TimeIncrementalStream

* correct chat json

* bump connector version

* add changelog

* run format

* auto-bump connector version

Co-authored-by: Roberto Bonnet <robertojuarezwp@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Remove all @ts-ignore (#14221)

* Bump hadoop to use version 3.3.3 (#14182)

* Change the persistence activity to use the new persistence layer (#14205)

* Change the persistence activity to use the new persistence layer

* Use lombok

* format

* Use new State message helper

* Fix build (#14225)

* Fix build

* Fix test

* Use new state persistence for state reads (#14126)

* Inject StatePersistence into DefaultJobCreator
* Read the state from StatePersistence instead of ConfigRepository
* Add a conversion helper to convert StateWrapper to State
* Remove unused ConfigRepository.getConnectionState

* Temporal per stream resets (#13990)

* remove reset flags from workflow state + refactor

* bring back cancelledForReset, since we need to distinguish between that case and a normal cancel

* delete reset job streams on cancel or success

* extract isResetJob to method

* merge with master

* set sync modes on streams in reset job correctly

* format

* Add test for getAllStreamsForConnection

* fix tests

* update more tests

* add StreamResetActivityTests

* fix tests for default job creator

* remove outdated comment

* remove debug lines

* remove unused enum value

* fix tests

* fix constant equals ordering

* make job mock not static

* DRY and add comments

* add comment about deleted streams

* Remove io.airbyte.config.StreamDescriptor

* regisster stream reset activity impl

* refetch connection workflow when checking job id, since it may have been restarted

* only cancel if workflow is running, to allow reset signal to always succeed even if batched with a workflow start

* fix reset signal to use new doneWaiting workflow state prop

* try to fix tests

* fix reset cancel case

* add acceptance test for resetting while sync is running

* format

* fix new acceptance test

* lower sleep on test

* raise sleep

* increase sleep and timeout, and remove repeated test

* use CatalogHelpers to extract stream descriptors

* raise sleep and timeout to prevent transient failures

* format

Co-authored-by: alovew <anne@airbyte.io>

* fix PostgresJdbcSourceAcceptanceTest by activating the feature flag (#14240)

* fix PostgresJdbcSourceAcceptanceTest by activating the feature flag

* fix AbstractJdbcSourceAcceptanceTest as well

* fix expected_spec for strict encrypt

* [13539] Fix integration tests source-clickhouse Mac OS (#14201)

* [13539] Fix integration tests source-clickhouse Mac OS
fixed unit tests

* [13524] Fix integration tests destination-clickhouse Mac OS
fixed unit tests

* 6339: error when attempting to use azure sql database within an elastic pool as source for cdc based replication (#14121)

* 6339: implementation

* 6339: changelog updated

* 6339: definitions updated

* 6339: definitions reverted

* 6339: still struggling with publishing

* auto-bump connector version

* 6339: definitions reverted - correct

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* 🪟 🎨 Update favicon and table row image styles (#14020)

* style changes to favicon and imageblock

* fix import

* revert component and props names to block

* Update airbyte-webapp/src/components/ImageBlock/ImageBlock.tsx

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* Update airbyte-webapp/src/components/ImageBlock/ImageBlock.module.scss

Co-authored-by: Vladimir <volodymyr.s.petrov@globallogic.com>

* Update airbyte-webapp/src/components/ImageBlock/ImageBlock.tsx

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>

* Update airbyte-webapp/src/components/ImageBlock/ImageBlock.module.scss

Co-authored-by: Vladimir <volodymyr.s.petrov@globallogic.com>

* add storybook

Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>
Co-authored-by: Vladimir <volodymyr.s.petrov@globallogic.com>

* upgrade potgresql version to fix default timestamp handling (#14211)

* implement logic to trigger snapshot of new tables via debezium (#13994)

* implement logic to trigger snapshot of new tables via debezium

* format

* improve test condition

* fix build

* BigQuery Denormalized "airbyte_type": "big_integer" to INT64 (#14079)

* BigQuery Denormalized "airbyte_type": "big_integer" to INT64

* updated changelog

* added unit test

* removed star import

* fixed checkstyle

* bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Add Metrics section to Scaling Airbyte doc (#14224)

* Added metrics section to scaling airbyte doc

* Updated URL in doc

* Deleted link

* Added link

* Added backslashes before brackets that aren't links

* Edited note about tagged metrics

* Changed list

* Changed spacing

* Changed spacing

* Changed spacing

* Deleted period

* Fixed broken firebolt link

* Added tables

* Cleaned up wording in tables

* Add ability to provide source/destination connector docker image (#14266)

* Add ability to provide source/destination connector docker image

* Make constant public

* Bump Airbyte version from 0.39.28-alpha to 0.39.29-alpha (#14232)

* disable flaky cmw test temporarily (#14269)

* release new postgres source connector version 0.4.29 (#14265)

* release new postgres source connector version 0.4.29

* add changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* :tada: Source Tiktok marketing - remove granularity config option (#13890)

* Removed granularity config option from spec, added corresponsing streams for each support granularity (hourly daily, lifetime), updated unittests, SAT

* auto-formating

* auto-formating

* removed AdvertisersIds stream from list of exposed streams, updated docs

* expose new style streams since 0.1.13, expose old streams for config for older version

* update spec

* fixed path to catalog

* increased timeout

* source bing-ads to ga (#13679)

* Source Tiktok marketing - increase connector version (#14272)

* increased connector version

* increased connector version in seed

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Fix flaky connection manager workflow test (#14271)

* try thread sleep instead of test env, and run 100 times

* replace testEnv.sleep with Thread.sleep in several tests

* replace RepeatedTest with Test

* replace testEnv.sleep with Thread.sleep after signals are executed

* run each test 100 times to see if any are flaky

* add log

* change repetitions to 100 to avoid out of memory

* format

* swap repeated test for normal test

* 13532 Fixed integration tests destination-mssql Mac OS (#14252)

* 13532 Fixed integration tests destination-mssql Mac OS

* Source Google Analytics: Specify integer for dimension ga:dateHourMinute (#14298)

* Specify integer for dimension ga:dateHourMinute
* Update changelog

* 🎉 Source Github: rename field `mergeable` to `is_mergeable` (#14274)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Update Airbyte Client (#14270)

* #12668 #13198 enable full refresh, disable incremental and expected_records (#14191)

* 🎉 Destination S3: update INSTANCE_PROFILE to use AWSDefaultProfileCredential (#14231)

Co-authored-by: Mike Balmer <remlabm@users.noreply.github.com>

* Source Zendesk Support: pagination group membership (#14304)

* add next_page_tooken and request

* correct group_membership paginatin

* update doc

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* 🪟 🐛 Fix OAuth validation not allowing to create source or destination (#14197)

* Enable "Set up source/destination" button only if the form is valid

* Update how ServiceForm initial values are patched so that it correctly patches the configuration with default values

* Update initial values patching in service form to use initialValues to preserve already set values
Update useOAuthFlowAdapter to correctly merge the values from the oauth response

* Remove unused values var from ServiceForm

* Add acceptance tests for per-stream state updates (#14263)

* Add acceptance tests for per-stream state updates

* PR feedback

* Formatting

* More PR feedback

* PR feedback

* Remove unused constant

* Make sure that the feature flag is transfer to container (#14314)

* Make sure that the feature flag is transfer to container

* propagate the feature flags

* Avoid propagating the feature flags

* Fix tests

* Source Postgres : use more simple and comprehensive query to get selectable tables (#14251)

* use more simple and comprehensive query to get selectable tables

* cover case when schema is not specified

* add test to check discover with different ways of grants

* format

* incr ver

* incr ver

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Fixed broken link

* Fix for deleting stream resets (#14322)

* Fix for deleting stream resets

* Fix build by updating var (#14321)

* Edited formatting (#14275)

* Avoid error when creating dupl stream reset (#14328)

* Bump Airbyte version from 0.39.29-alpha to 0.39.30-alpha (#14329)

Co-authored-by: lmossman <lmossman@users.noreply.github.com>

* Release new postgres strict encrypt version (#14331)

* Bump postgres strict encrypt version

* Update changelogs

* Update doc

* Release new destination s3 version to pick up latest change (#14332)

* Bump s3 version

* Update pr id

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* 13538 Fix integration tests destination-scylla Mac OS (#14308)

* 13538 Fix integration tests destination-scylla Mac OS

* Update cdk-speedrun.md (#14258)

Added a link at the bottom of the article , so the user may find the more in-depth tutorial about building a real-world connector.

* Update README.md (#14303)

Added a link to https://airbyte.com/tutorials/extract-data-from-the-webflow-api in Webflow's README.md

* Update building-a-python-source.md (#14262)

* Update webflow.md (#14254)

Added a link to the new blog - https://airbyte.com/tutorials/extract-data-from-the-webflow-api

Co-authored-by: Simon Späti <simu@sspaeti.com>

* Alex/declarative stream incremental fix (#14268)

* checkout files from test branch

* read_incremental works

* reset to master

* remove dead code

* comment

* fix

* Add test

* comments

* utc

* format

* small fix

* Add test with rfc3339

* remove unused param

* fix test

* 🐛 SingerSource: Fix incompatibilities and typing issues (#14148)

* Use logging.Logger in SingerSource

* Fix SingerSource ConfigContainer

This fixes typing issues with `ConfigContainer` and makes it compatible
with `split_config`. Fixes #8710.

* Fix SingerSource state and catalog typer issues

* Rename SingerSource method args to match parent classes

* Remove old comment about excluding Singer

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>

* Update source postgres release stage to beta (#14326)

* fix NPE (#14353)

* fix NPE

* Add test

* Fix trailing

* 🎉 octavia-cli: Add ability to import existing resources (#14137)

* helm chart: Add Image Pull Secrets Param  (#14031)

* fix format (#14354)

* Bump Airbyte version from 0.39.30-alpha to 0.39.31-alpha (#14355)

Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>

* tiktok to ga (#14358)

* Update state.state type (#14360)

* Run some DATs as part of base-normalization tests (#14312)

* Revert "🎉 Source Github: rename field `mergeable` to `is_mergeable` (#14274)" (#14338)

* Revert "🎉 Source Github: rename field `mergeable` to `is_mergeable` (#14274)"

* Properly update the hasEmitted state (#14367)

* Bmoric/state aggregator (#14364)

* Update state.state type

* Add state aggregator

* Test and format

* PR comments

* Move to its own package

* Update airbyte-workers/src/test/java/io/airbyte/workers/internal/state_aggregator/StateAggregatorTest.java

Co-authored-by: Lake Mossman <lake@airbyte.io>

* format

* Update airbyte-workers/src/main/java/io/airbyte/workers/internal/state_aggregator/DefaultStateAggregator.java

Co-authored-by: Lake Mossman <lake@airbyte.io>

* format

Co-authored-by: Lake Mossman <lake@airbyte.io>

* Bump Airbyte version from 0.39.31-alpha to 0.39.32-alpha (#14383)

Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>

* 🐛 Source Mixpanel: fix SAT tests (#14349)

* Call the new revoke_user_session endpoint from the FE (#13165)

* Source Instagram: change releaseStage to GA (#14162)

* Source Google Analytics: Change releaseStage to GA (#13957)

* source-outreach: fix record parsing and cursor field access (#14386)

* Kustomize: Use `resources` since `bases` is deprecated (#14037)

* fix: clone api doesn't take update configurations (#13592)

* fix: clone api doesn't take update configurations

* fix: you will be able to create clone in different workspace

* fix: added description to source/destination body

* cdk: Attach namespace to stream  in catalog (#13923)

* Source TiDB: correct jdbc string builder (#14243)

* add icon for tidb-connector

* Fix TiDB source connector

* bump connector version

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* Source Google Ads: use docsaurus feature for warn/note and udpdate doc (#14392)

* use docsaurus feature for warn/note and udpdate doc

* update description in supported streams

* Source Facebook Marketing: allow configuration of MAX_BATCH_SIZE (#14267)

* Add max batch size config

* Bump semver

* add changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* 🎉 Source Github: add Retry for GraphQL API Resource limitations (#14376)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Add more metadata to the JobErrorReporter (#14395)

* add workspace_id and connector_repository as tags

* add tag for connection url

* fix urls for job notifier

* format

* fix failing test

* beta -> generally_available (#14315)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* helm chart: Fix/double printing of extra volume mounts (#14091)

* SentryJobErrorReporter: better handling of multiline chained java exceptions (#14398)

* Docs: deploy on gcp use docusaurus tabs (#14401)

* Revert "Kustomize: Use `resources` since `bases` is deprecated (#14037)" (#14415)

This reverts commit 5c9a6a5fc655a9e597f755be8fc8ccf805a2537a.

* Use Debezium Postgres image for CDC tests (#14318)

* Use Debezium Postgres image for CDC tests

* Formatting

* 🎉 octavia-cli: Add ability to import all resources (#14374)

* Bump Airbyte version from 0.39.32-alpha to 0.39.33-alpha (#14419)

Co-authored-by: pedroslopez <pedroslopez@users.noreply.github.com>

* 📝 MySql source: clarify tinyint to number conversion when size > 1 (#14424)

* 🪟 🐛 Fix Setup Source Button on OAuth Sources (#14413)

* don't disable setup button

* make eslint happy

* one more cleanup

* use the spec to decide how to create config object

* Bump Airbyte version from 0.39.33-alpha to 0.39.34-alpha (#14428)

Co-authored-by: timroes <timroes@users.noreply.github.com>

* [low-code cdk] Enable configurable state checkpointing (#14317)

* checkout files from test branch

* read_incremental works

* reset to master

* remove dead code

* comment

* fix

* Add test

* comments

* utc

* format

* small fix

* Add test with rfc3339

* remove unused param

* fix test

* configurable state checkpointing

* update test

* fix type hints (#14352)

* normalization: Do not return NULL for MySQL column values > 512 chars  (#11694)

Co-authored-by: Augustin <augustin.lafanechere@gmail.com>
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>
Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Tim Roes <tim@airbyte.io>
Co-authored-by: Charles <charles@airbyte.io>
Co-authored-by: Jonathan Pearlin <jonathan@airbyte.io>
Co-authored-by: Amruta Ranade <11484018+Amruta-Ranade@users.noreply.github.com>
Co-authored-by: Benoit Moriceau <benoit@airbyte.io>
Co-authored-by: Jimmy Ma <jimmy@airbyte.io>
Co-authored-by: Ganpat Agarwal <gagarwal@artica.com>
Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Rajakavitha Kodhandapani <krajakavitha@gmail.com>
Co-authored-by: Yevhen Sukhomud <suhomud@gmail.com>
Co-authored-by: Andrii Leonets <30464745+DoNotPanicUA@users.noreply.github.com>
Co-authored-by: George Claireaux <george@claireaux.co.uk>
Co-authored-by: VitaliiMaltsev <39538064+VitaliiMaltsev@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: sw-yx <shawnthe1@gmail.com>
Co-authored-by: Baz <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Octavia Squidington III <90398440+octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>
Co-authored-by: Eugene <etsybaev@gmail.com>
Co-authored-by: Denis Davydov <davydov.den18@gmail.com>
Co-authored-by: Anna Lvova <37615075+annalvova05@users.noreply.github.com>
Co-authored-by: Vladimir <volodymyr.s.petrov@globallogic.com>
Co-authored-by: Phlair <Phlair@users.noreply.github.com>
Co-authored-by: Parker Mossman <parker@airbyte.io>
Co-authored-by: Adam <adam-bloom@users.noreply.github.com>
Co-authored-by: Liren Tu <tuliren@gmail.com>
Co-authored-by: pmossman <pmossman@users.noreply.github.com>
Co-authored-by: Topher Lubaway <asimplechris@gmail.com>
Co-authored-by: Brian Lai <51336873+brianjlai@users.noreply.github.com>
Co-authored-by: Peter Hu <peter@airbyte.io>
Co-authored-by: Subodh Kant Chaturvedi <subodh1810@gmail.com>
Co-authored-by: Tuhai Maksym <kimerinn@gmail.com>
Co-authored-by: Alexander Marquardt <alexander.marquardt@gmail.com>
Co-authored-by: sajarin <sajarindider@gmail.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: steve withington <steve@digitalmine.com>
Co-authored-by: Leo Sussan <leosussan@gmail.com>
Co-authored-by: cenegd <cenegd@live.com>
Co-authored-by: Tomas Perez Alvarez <72174660+Tomperez98@users.noreply.github.com>
Co-authored-by: Lake Mossman <lake@airbyte.io>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Yurii Bidiuk <yura.bidyuk@gmail.com>
Co-authored-by: Christophe Duong <christophe.duong@gmail.com>
Co-authored-by: Teal Larson <LARSON.TEAL@GMAIL.COM>
Co-authored-by: Sophia Wiley <106352739+sophia-wiley@users.noreply.github.com>
Co-authored-by: jdpgrailsdev <jdpgrailsdev@users.noreply.github.com>
Co-authored-by: Jimmy Ma <gosusnp@users.noreply.github.com>
Co-authored-by: Stella Chung <schung507@gmail.com>
Co-authored-by: Amanda Murphy <amanda.murphy@heapanalytics.com>
Co-authored-by: Mohamed Magdy <mohamed.magdy@canary.is>
Co-authored-by: nataly <nataly@airbyte.io>
Co-authored-by: Tyler Russell <tylerrussell85@gmail.com>
Co-authored-by: Alexander Tsukanov <alexander.tsukanovvv@gmail.com>
Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
Co-authored-by: brianjlai <brianjlai@users.noreply.github.com>
Co-authored-by: terencecho <terence@airbyte.io>
Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: terencecho <terencecho@users.noreply.github.com>
Co-authored-by: Daniel Diamond <33811744+danieldiamond@users.noreply.github.com>
Co-authored-by: drrest <dr.rest@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
Co-authored-by: Zawar Khan <zawar.khan@getmercury.io>
Co-authored-by: ptiurin <petro.tiurin@firebolt.io>
Co-authored-by: Greg Solovyev <grishick@users.noreply.github.com>
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
Co-authored-by: sherifnada <sherifnada@users.noreply.github.com>
Co-authored-by: Sachin Jangid <sachinjangid832@gmail.com>
Co-authored-by: Chris Wu <chris@faros.ai>
Co-authored-by: Jared Rhizor <me@jaredrhizor.com>
Co-authored-by: tison <wander4096@gmail.com>
Co-authored-by: Roberto Bonnet <robertojuarezwp@gmail.com>
Co-authored-by: Malik Diarra <malik@airbyte.io>
Co-authored-by: alovew <anne@airbyte.io>
Co-authored-by: Oleksandr Sheheda <alexandr-shegeda@users.noreply.github.com>
Co-authored-by: midavadim <midavadim@yahoo.com>
Co-authored-by: Arsen Losenko <20901439+arsenlosenko@users.noreply.github.com>
Co-authored-by: Ryan Lewon <ryan@segv.net>
Co-authored-by: Mike Balmer <remlabm@users.noreply.github.com>
Co-authored-by: Anne <102554163+alovew@users.noreply.github.com>
Co-authored-by: Liren Tu <tuliren.git@outlook.com>
Co-authored-by: Simon Späti <simu@sspaeti.com>
Co-authored-by: Albin Skott <cstruct@users.noreply.github.com>
Co-authored-by: Caleb Fornari <calebfornari@gmail.com>
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
Co-authored-by: Christian Martin <christian@ctmartin.me>
Co-authored-by: jordan-glitch <65691557+jordan-glitch@users.noreply.github.com>
Co-authored-by: Daemonxiao <35677990+Daemonxiao@users.noreply.github.com>
Co-authored-by: Keith Thompson <keithjoethompson@gmail.com>
Co-authored-by: Leo Sussan <leo@reach.vote>
Co-authored-by: pedroslopez <pedroslopez@users.noreply.github.com>
Co-authored-by: timroes <timroes@users.noreply.github.com>
Co-authored-by: Johannes Nicolai <jonico@planetscale.com>
@grishick grishick mentioned this pull request Jul 20, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@benmoriceau benmoriceau benmoriceau left review comments

@cgardens cgardens cgardens left review comments

@grishick grishick grishick approved these changes

@subodh1810 subodh1810 subodh1810 approved these changes

Assignees
No one assigned
Labels
area/connectors Connector related issues connectors/source/jdbc connectors/source/mssql connectors/source/mysql connectors/source/postgres connectors/source/relational-db
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@jdpgrailsdev @benmoriceau @grishick @cgardens @subodh1810 @octavia-squidington-iii